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PREFACE 


This book has been written, first of all, to scn'e as a text for a 
one-semester advanced undergraduate or beginning graduate 
course in nonlinear differential equations. However, since it was 
prepared with the needs of the applied mathematician, engineer, 
and physicist specifically in mind, it should also prove useful as 
a reference text for scientists and engineers working in applied 
fields. This is not to suggest that the book is anything but a 
mathematics text; rather, it is to suggest that we must recognize 
and then compensate for the limited mathematical experience 
of many who today encounter and ponder nonlinear problems. 
There is nothing new in this approach, but it is seldom seen in 
mathematical works written for those with the high level of 
knowledge and achievement expected here. For example, it may 
appear inconsistent to place side by side elementary discussions 
of standard mathematical notation and advanced analytical 
techniques, but the alternatives are either to accept a mathe¬ 
matically unsatisfactory and incomplete job or to continue to 
deny a vast audience the genuine fruits of this vital and dynamic 
subject. 

It has been the intention of the author to provide for rapid 
(though modest) contact with a majority of the mathematically 
significant concepts of nonlinear differential equations theory 
without overburdening the reader with a lot of loose ends. A 
concerted attempt has been made for brevity of treatment (con¬ 
sistent with mathematically sound principles) and simplification 
of concepts. Thus, it has been the further intention of the author 
to err (if he must) by recording all too little, rather than too 
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much, and by oversimplifying, rather than overgeneralizing. 
The resultant shortcomings of this approach may, perhaps, be 
compensated by the multitude of exercises which form an integral 
part of the text. These contribute limited amounts of auxiliary, 
though sometimes essential, material, prepare the reader for 
subsequent work, and provide a running criticism of the text 
material itself. For the student, the last function of the exercises 
is by far the most important, and it is questionable if one can 
appreciate the real flavor of the work without careful note of this 
fact. Examples appear throughout the text and in the lists of 
exercises. These also contribute additional material, but more 
often than not, serve to illustrate the theorems, important con¬ 
cepts, or merely the notation and, in doing so, provide a link with 
more practical aspects of the theory. Chapter 8, which consists 
entirely of examples, stands in marked contrast to the theoretical 
pattern established in the earlier chapters. The asymptotic 
method illustrated therein is eminently practical and should dis¬ 
pel the notion that a variety of specialized techniques is required 
for treating traditional problems relating to linear and nonlinear 
oscillations. 

The chapter and section titles are a sufficient indication of the 
total content. Though the chapter material represents a con¬ 
nected account of many areas of interest, the chapters themselves 
are not significantly interdependent and represent more or less 
distinct blocks of the total structure. A well-informed teacher 
may readily expand the content of any one chapter, drop or 
replace a chapter which, for example, might represent old mate¬ 
rial for a select audience, or insert a particular text chapter into 
another course or seminar. Only a few of the more pertinent 
references are given throughout the text. The list of general 
reference.s includes excellent bibliographical sources, as well as 
other related information. 

The starting point of this book was a set of lecture notes pre¬ 
pared for (and during) an internal seminar held at The Martin 
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Company, Denver Division. I wish to record here my apprecia¬ 
tion to The Martin Company for providing me with the oppor¬ 
tunity to participate in this seminar and with excellent secre¬ 
tarial help during the preparation of the lecture notes. I should 
like to thank John E. Fletcher and Steve M. Yionoulis for valua¬ 
ble assistance in the preparation of the manuscript and Mary 
Sue Davis for a superb job in typing the manuscript. As a 
student, I was fortunate to inherit from my teachers, especially 
Ky Fan, Joseph P. LaSalle, Karl Monger, and Arnold E. Ross, 
some of the rich traditions and finer things in mathematics. I 
sincerely hope that through this book I will share with future 
students at least a small part of this inheritance. 

Raimond A. Struble 
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1 . Linear Second-order Equations 

Consider the differential equation 

^ + . = 0 ( 1 ) 

which leads to the simple harmonic motion 

X = A sin (( + 4») (2) 

for arbitrary (constant) A and 4>. Let us introduce a second 
variable 

!/ = ^ = /I cos (i + *) (3) 

SO that (2) and (3) together define the circle x- + </- = .4- in 
parametric form with t as parameter. The solution in the xy 
plane is viewed, therefore, as a circle of radius 1.41 centered at the 
origin. 

A solution eurve, viewed in the xy plane, is called a trajectory, 

and the xy plane itself is called the phase plane. A trajectory is 

oriented by the parameter t, and the direction of increasing t is 

indicated as in Fig. 1 by arrowheads. Note that from the defini- 

t ion of y, the arrowheads necessarily point toward posit ive x above 

the X axis and toward negative x below the x axis. clockwise 

1 
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motion is thus indicated. The trivial solution of (1) corresponds 
to the origin x = 0, 3/ = 0 and is called a singular solution or 
-poinl solution. It represents a position of equilibrium. In this 
case there is but one position of equilibrium, and it is called a 
center, since all near trajectories are closed paths. Closed paths 
generally (but not always) correspond to periodic solutions, while 
periodic solutions always lead to trajectories which are closed 
paths. 




Let us now consider the trajectories defined by the equation 




(4) 


where each of k and w is a constant. Without damping, i.e., 
fc = 0, each trajectory of (4) is an ellipse (see Fig. 2). However, 
with damping, the trajectories are modified considerably. The 
nature of a solution depends upon the characteristic roots, 



We shall examine the various cases in turn. 
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Case 1:u^> {k/2y 

Let coi = — (fc/2)* so that Xi.i = —k/2 ± ioii. The 

general solution is well known, namely, x = sin (wi^ + <f) 

for arbitrary A and 4>. In this case 

y = — h sin (wii + '^) + cos (wii + 4>) 

i 

Let us introduce new dependent variables 

u = wix = wiAc“‘"“ sin (wi( + <I>) (5) 

y = y + ^ X = COS (wi( + 

If we interpret the solution as a trajectory in the uv plane, we 
obtain a spiral. Indeed from (5) we have 

p* = u* + 

and ^ = tan {uit + $) 

Thus, for example, if fc > 0, p* decreases monotonically as t 
increases, while the ratio u/v varies periodically with t (see 
Fig. 3). Again the motion is clockwise, although in this case v 



Figure 3 
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is not du/di. In fact, w and v satisfy the equations 


du 

dt 

4a 

dt 


^ _L 

— 2 w + wiw 




For k < 0, the trajectories spiral clockwise away from the origin. 
We note that the uv origin corresponds to the xy origin, i.e., the 
position of equilibrium. It is called a focus since near trajectories 
spiral either to or away from it. 

This rather simple picture of the trajectories has been obtained 
through the use of the transformation (5). The latter is a linear 
transformation of the form 


u = 6iix + buy 
V = 621! + 622^ 

If the determinant 

hit biz 

bzi bz2 

is different from zero, then the mapping (7) is a one-to-one map¬ 
ping of the xy plane onto the we plane. Such transformations 
have the following important properties: 

a. The origin maps to the origin. 

b. Straight lines map to straight lines. 

c. Parallel lines map to parallel lines. 

(/. The spacings of parallel lines remain in proportion. 

These hold eitlior for the mapping from the xy plane to the uv 
plane or for the inver.se mapping from the i/r plane to the xy plane. 
Ihiis an ('(iuilateral rectangular grid work will, in general, map 
onto a skewed grid work with different but uniform spacing in 
each of the two skewed directions. Many qualitative features 
of the trajectories arc invariant under such transformations. 
For example, the logarithmic spiral in Fig. 3 is the image, under 
the linear transformation (5), of the distorted spiral in Fig. 4. 
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Some quantitative information may be obtained as follows. 
Let us consider the linear transformation 




as a mapping from the two-dimensional x\j vector space onto the 
two-dimensional uv vector space. Using rectangular cartesian 



X 


Figure 4 




representation, as in Fig. 5, each xy vector may be identified with 
its end point ix,y) and its image vector under the transformation 
(8) by the end point {u,v) in the uv plane. We ask the following 
question: Are there any vectors in the xy plane which do not 
rotate under the transformation (8)? Such vectors are called 
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eigenvectors of the linear transformation. If (w,y) is parallel to 
(x,y), the ratios v/u and y/x are equal, or what is the same, there 
exists a number a, called an eigenvalue of (8), for which 

%L ctX 

(9) 

V = ay 

The eigenvalue itself is a “stretching” factor, since the length of 
the uv vector is |a| times the length of the corresponding xy 
vector. But from (8) and (9) we conclude that necessarily 



or, what is the same, 

(wi — <af)x = 0 
+ (1 — a)y = 0 

In general, there are two nontrivial solutions of (10): 

a ~ 1 X = 0 (y, arbitrary) 

k 

a = ^ X -h (1 — wOy = 0 

corresponding to the two eigenvalues a — 1, a = wi. 

(11) and (12) are one and the same. More generally, the first 
asserts that vectors parallel to the y axis are not rotated, while the 
second asserts that vectors with slope equal to fc/2(a>i — 1) are 
not rotated. Further, since a = 1 in (11) and a = wi in (12), we 
conclude that the lengths of the vectors parallel to the y axis 
remain unchanged while the lengths of the vectors with slope 
equal to fc/2(aii — 1) are stretched by the factor ui. Thus the 
distorted spiral in Fig. 4 is obtained from the logarithmic spiral in 
Fig. 3 by moving the intercepts with the line u = [fc/2(wi - l)]i; 
(shown for wi < 1) outward in proportion to 1/wi, while leaving 
the intercepts on the v axis as they are. 


( 10 ) 


( 11 ) 

( 12 ) 

If Wl = 1, 
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Case 2; (fc/2)= > w* 

Let us write the single equation (4) as the system 


(13) 


^ - 


In this case, we seek a linear transformation (7) such that the 
system (13) becomes 






(14) 


for suitable constants ai, a:- The system (14) is "uncoupled” 
and the solutions may be obtained immediately. 

Applying the transformation (7) to (14) and using (13), we 

obtain 

buy + 6 ij( —— ky) = ai( 6 iix + buy) 
buy + 6 i 2 (“w*x — ky) = a 2 ( 65 ix 4* buy) 

If these equations are to hold identically in x and y, then the total 
coefficient of each of x and y must vanish. We consider, there¬ 
fore, the two sets of equations 



— o)*6i2 = ai6n 

(16) 


II 

1 

and 

— = 0(2^21 
bzi " kb2^ “ cxibti 

(17) 


The first of (16) may be written 


(18) 


and the second then becomes 


1 


( 19 ) 
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Similarly, the two equations of (17) yield 


and 





(20) 

( 21 ) 


Equations (19) and (21) are merely versions of the characteristic 
equation X* + fcX + w* = 0. Thus each of ai and 02 must be a 
characteristic root. 

With ai and 012 determined, Eqs. (18) and (20) determine the 
ratios hu/bu and For convenience, we may choose 

bn = 621 = w®, and the desired linear transformation may be 
expressed 

( 22 ) 

V = to-X — X 2 I/ 

We note that the determinant 




is different from zero, since Xi ^ X 2 . Thus (22) is nonsingular. 

In the new variables, the solutions are given by (14) with 
cti = Xi and 0-2 = X 2 . We have 


u = 

V — 



for arbitrary vo and y©. For k > 0, both characteristic roots are 
negative and so each trajectory in the uv plane approaches the 
origin as / ► cc. Further, the ratio 


u 

V 


g(X,-Xi>l 

Vo 


approaches zero as t-* «, since Xi — X 2 = ~2 V(it/2)* - 
Thus the trajectories are asymptotic to the v axis. From (23) 
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we have 






uo*" 

—r = const 


so that the uv trajectories lie along the curves u = (const)!-^''*^’. 
The singular solution in this case is called a tiodc. (All near 
trajectories tend to or away from a node without spiraling.) For 
A: < 0, the solution cur\'es are somewhat similar to those illus- 
trated in Fig. 6. However, since both characteristic roots are 



then positive, the arrows must be reversed and the labels on the 
two axes must be interchanged. 

The trajectories in the phase plane are also qualitatively similar 
to those shown in Fig. 6 but will appear to be rotated and 
stretched. The eigenvalues of the transformation (22) are roots 
of the equation 




+ (X 2 ~ w*)X -{- (Xi — Xsjw* = 0 


and the eigenvectors (i.e., invariant directions) could be obtained 
as before. However, in this case it is probably more important 
to know what happens to the u axis and v axis under (22). The 
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u axis maps to the line y = while the v axis maps to the 

line y = Thus the trajectories in the phase plane will 

appear as in Fig. 7. 




Figure 7 


Case 3: (fc/2)* = 

The special case where the characteristic roots Xi and Xj are 
equal demands special treatment. In this case, the equations 
cannot be completely uncoupled. However, it is possible to find 
a linear transformation (7) such that one of the transformed 
equations becomes independent of the other. It may be solved 
first, and the known solution used in the remaining equation, 
which then becomes solvable. We use the first equation of (22) 
and a second equation independent of the first. Since the latter 
is arbitrary, except that it must be independent of the first equa¬ 
tion, we make it simple. Let 


u = aj*x — Xiy 




x + ^y 


V 


( 24 ) 
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60 that 

du 

Tt 

Tt 

Thus 



u = Woe 


for arbitrary uo, and 


dv 



-ktit 


k 

2 


V 



(25) 


(26) 

(27) 


Integration of (27) yields 

= wofc-^"* + (28) 

for arbitrary fo- For fc > 0, Eqs. (26) and (28) assert that each 
trajectory in the uv plane approaches the origin as t—* *. 



u 


Figure 8 


Further, the ratio v/u = t vo/uo indicates that each trajectory 
is asymptotic to the v axis. Using (25), we have 

dv _ dv/dt _ _ 2 , y 
du ~~ du/dt u 



12 NONLINEAR DIFFERENTIAL EQUATIONS 


Thus dv/du = 0 along the line v = 2u/k. Above this line, the 
tangents to the trajectories have positive slopes for w > 0 and 
negative slopes for u < 0, while below this line, the tangents have 
negative slopes for w > 0 and positive slopes for u < 0. The 
trajectories appear as in Fig. 8. According to (24) the line 
V — 2u/k maps to the line kx/2 = kx/2 + y or, what is the same, 



to the line y - 0. The asymptote t/ = 0 maps to the line 
y ~ — kx/2. Thus the trajectories in the phase plane appear 
as in Fig. 9. A comparison of Figs. 8 and 9 suggests that the 

linear transformation (24) involves a reflection as well as rotation 
and stretching. 


C.\SE 4 : 

In order to treat the linear second-order system completely, we 
must consider the case when is replaced bj' a negative quantity, 
say, - 0 - 2 . Here may use the results of Case 2 directly. A 
transformation analogous to (22) leads to a solution of the form 
(23). However, regardless of the sign of fc, one of Xi and Xj is 
positive, while the other is negative. For the sake of illustration 
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we may assume X 2 is positive. Then u 0 and v—* « as f ^ , 

while the ratio u/v ~ ► 0. The trajectories in the 

uv plane thus appear as in Fig. 10. The origin is called a saddle 



Figure 10 


point for rather obvious reasons. The w axis and r axis map to 
the lines 



respectively. Hence the phase-plane trajectories appear as in 
Fig. 11. 

The general two-dimensional first-order system 



dy , 

ji = cx + ey 



with each of a, b, c, and e constant is equivalent to the general 
second-order equation (4). For example, if we introduce the 
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variable 2 = ax + by, then (30) becomes 
dx 

dt ^ 

^ = a— + = az + bcx bey =- az + bcx + eiz - ax) 

dt dt dl 

= (be — ea)x + (a + e )2 
and so x satisfies the second-order equation 

^_(„ + e)| + (ea-6c)x==0 

which is of the form (4). Of course, the quantity ea - be may 
be negative as in Case 4 above. On the other hand, every 



second-order equation of the form (4) leads to a first-order system 
of the form (30) with y = dxfdi. The parameter t is eliminated 
from the system (30) upon dividing the second equation by the 
first. The resulting equation 

^ _ ex + ey 
dx ax by 


then defines the direction field (or vector field) in the phase 
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plane, and the trajectories are merely the integrals of this direc¬ 
tion field, parameterized in the simplest and most natural manner. 
We note that the direction field may also be expressed in the 

differential form 

dy _ dx 
cx + ei/ ax -f by 

which readily generalizes to higher dimensions. 

EXERCISES 

1. Solve the equation 

^ = 0 (i) 

as follows. Multiply (i) by dx/dt and integrate to obtain 

+ ai*x* = c const > 0 (ii) 

Thus the phase-plane trajectories (see Fig. 2) are the concentric 
ellipses y* -f- wV = c. Separate the variables in (ii), and com¬ 
plete the integration. Note that one obtains t as a function of x. 

2. Derive (6) using (8) and (13). 

3. Using (6), show that satisfies the differential 

equation dp^/dl = ~kp^ and hence is given by p* = (const)c-*'. 

4. Obtain the inverses of the linear transformations (7) and (8). 

5. Verify the four properties of linear transformations a, b, c, 
and d stated in Case 1. 

6. Show that an eigenvalue X of the general linear transforma¬ 
tion (7) satisfies the equation 

6ii — X bn 
bji bn ~ X 

7. Obtain the eigenvectors of the linear transformation (22). 

8. Find the inverse of the linear transformation (22), and use 
this inverse to obtain the phase-plane solutions of (13) from (23). 
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9. Find the inverse of the linear transformation (24), and use 
this inverse to obtain the phase-plane solutions of (4) from (26) 
and (28). 

10. Using (14), show that w = u/v satisfies the differential 
equation dw/dt = (ai — oc^w and hence is given by 

w = (const)e<“'““*^‘ 

11. Apply the method used for Case 2 to obtain the solutions 
for Case 1. 

12. As in Case 3, adjoin to the second equation of (22) the 
equation w = x, and obtain differential equations for u and v 
which together form a system equivalent to (4). Solve the uv 
differential equations, invert the linear transformation, and 
obtain the phase-plane solutions. 

13. Discuss paramctcrizations of the integral curves of the 
direction field dij/dx — {cx -f- eij)/{ax 4- by) other than (30). 
For example, consider arclength as a parameter, and obtain 
appropriate equations. 

14. Dbeuss the phase-plane trajectories of (4) for the degen¬ 
erate case (j3- ~ 0. Notice that the origin is not a center, a node, 
or a focus. 

15. Characterize the lujlure of the singular solution x = 0, 
y = 0 of the system (30) iii terms of the coefficients a, b, c, and e. 

2 . Some Nonliiiear Second-order Equations 

C'onsidcr the nonlinear equation 

= 0 (31) 

which is known as the Duffing equation. Normally, |j3| is a small 
con.stant and depicts a small deviation from linearitj' in the 
restoring term. If 0 > 0, (31) is referred to as the hard spring 
case, while if 0 <0, (31) is referred to as the soft spring case. It 



PRELIMINARY CONSIDERATIONS 


i: 


is equivalent to the system 


17 = y 


dx 

Jt 

(h 

dl 


^ = -a.2x - 


with the direction field given by 


dx 


oi^x -}- |3x* 

y 




If the variables in (33) are separated, one obtains for the integral 
curves 

= c (34) 

where c is an integration constant. Kor positive /3, real solutions 
exist only for c > 0 and these are illustrated in Fig. 12. The 



constant of integration c represents an energy level for a given 
trajectory. The origin is a singular trajectory (a center), while 
the nontrivial solutions are represented by a family of concentric 
closed paths. The latter represent periodic solutions of (31). 
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The trajectories for /9 < 0 are illustrated in Fig. 13. In this 
case, there are three singular solutions. These are represented by 
the origin and the points ^ = 0, x = ± (w*/ — /S) on either side of 
the origin. The origin is a center, while each of the other two 
singular trajectories is a saddle point. Indeed, near the origin 
all trajectories are closed paths and correspond to periodic solu- 



Figure 13 


tions. These are very similar to the periodic solutions of Fig. 12 
near the origin. The heavy loop enclosing the origin in Fig. 13 
consists of two special .solutions called scparalriccs. Also, there 
arc four other separalrices which arc depicted in Fig. 1.3 by the 
heavy curves on either side of the saddle points. 


The final integration is 
tion of variables in (34). 


reduced to a quadrature upon separa- 
Thus, we have 



_dx_ 

± x\u>- + iSx-^) 



The several cases illustrated in Figs. 12 and 13 correspond to 
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various choices of c and /3. In general, a quadrature of (35) will 
involve elliptic integrals and elliptic functions. Reduction to 
standard form in each case is left as an interesting exercise for the 
student. 

If in (31) the parameter /3 is given by 0 = then (31) 

becomes 



and the spring characteristic /(x) = x — xV6 is recognized as a 
two-term power-series expansion of sin x. Thus it might be 
expected that those solutions with |xl small would be similar to 
those of the equation 

(Px . , . 

-h 0.2 sin X = 0 (37) 


Equation (37) is referred to as the simple pendulum equation since 
it depicts the idealized motions of a simple pendulum in a vacuum. 
The “small" oscillations of a simple pendulum are given approxi¬ 
mately by (30). However, (37) is no more difficult to treat than 
its approximate (30). Equation (37) is equivalent to the system 



dl 


— w* sin X 



with a direction field given by 


dx 



sin X 

y 


(39) 


If the variables in (39) are separated, one obtains for the phase- 
plane trajectories the equation 

yi 

y - cos X = c (40) 


where c is an integration constant. These trajectories are 
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illustrated in Fig. 14. Owing to the periodic term in (40), there 
are infinitely many singular trajectories. There are centers 
located along the x axis at each even multiple of tt and saddle 
points at each odd multiple of tt. The closed trajectories near 
each center represent the oscillatory motions of the pendulum 
which center about the stable equilibrium position. The saddle 
points correspond to the unstable equilibrium position (the 
inverted pendulum), while the wavy curves in Fig. 14, appreciably 



Figure 14 


away from the x axis, correspond to the rotary (spinning) motions 
of the pendulum. The transition fi'om oscillatory and to rotary 
motion (the heavy loops in Tig. 14) is depicted by separatrices. 

The final integration again reduces to a quadrature. For upon 
separation of variables in (40), one obtains 


dt = - 

+ Vc + cos X 


(41) 


which again leads to elliptic integrals and elliptic functions. 

Typical effects of damping in a nonlinear system are illustrated 
in the equation 

d\v , dx dx , 

~dt^ = 0 


( 42 ) 
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If fc > 0, the damping acts in opposition to the motion, while the 
magnitude of the damping is proportional to the square of the 
speed. This is referred to as Newtonian damping. Equation 
(42) depicts the Newtonian damped motions of a simple pen¬ 
dulum. It is equivalent to the system 



dl 


— sin X — ky\y\ 


(43) 


with direction field 


dy _ _ sin x Au/j^l 
dx y 

The latter may be expressed in the form 


dx 


± 2ky^ = 


— 2w- sill X 


(44) 



where the plus sign prevails whenever ^ > 0, and the minus sign 
whenever y < 0. Except for these changes in sign, (45) is a 
linear equation in the quantity with x as independent variable. 
Hence, the solutions of (45) are elementary. In fact, one writes 
immediately 


1/* = -|- 


2ci>* 

rriF 


cos X — 


4«2( + /t) 
1 + 4A;* 


sin X 


(46) 


where c is an integration constant, and where the (±) sign is as 
in (45). It is only necessary to ascertain the proper choices of 
the integration constant so as to “fit together” the pieces of a 
solution given in (46) as the sign changes become effective. This 
occurs in the phase plane, of course, at each point where a trajec¬ 
tory crosses the x axis. The trajectories defined by (40) are 
illustrated in Fig. 15. As in the case of an undamped pendulum, 
the points y = Q, x = 0, +)r, ±2 t, . . . represent singular 
solutions. The odd multiples of tt correspond to saddle points. 
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and the even multiples of ir correspond to (stable) foci. Figure 15 
shows that every nontrivial trajectory (other than the separatrices 
going into the saddle points) ultimately winds about one of the 
foci. Thus, the motion of the pendulum ultimately reduces to 
damped oscillations centered about the stable equilibrium posi¬ 
tion. The number (if any) of full rotations exhibited by the 
pendulum, prior to the oscillatory phase, depends upon the initial 



Figure 15 

magnitude of y = dx/dt. As to be expected, the greater the 
initial speed, the greater the number of full rotations. 

As in the previous examples, the final integration reduces to a 
quadrature. For upon separation of variables in (46), one 
obtains 

dt = 

_ dx 

± + 2u)V(l -1- 4 fc 2 ) cos X - [4u>"(±fc)/(l sin X 

However, in this case, a numerical quadrature is indicated. 

EXERCISES 

1. For 0 > 0 and c > 0, determine the two real roots of the 
equation 




(i) 
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These are the x intercepts of a phase-plane trajectory in Fig. 12 
and are at a distance r from the origin. With the change of 
variable x/r = cos 6 , show that t he right member of (35) pro¬ 
portional to dd/Vl - At- sin* 0, where A* < 1. Express the 
solution of (31) in terms of standard elliptic functions, and 
determine the least period of the motion. 

2. For ^ < 0, show that (i) has real roots only for c < —w-/2d. 
In particular, show that (i) has four real roots for 0 < c < 
— wV2/? and two real roots for c < 0. Discuss the roots of (i) for 
c = — wV2j3 and c = 0. 

3. The trajectories appreciably away from the x axis in Fig. 13 
correspond to values of the integration constant c greater than 
-«V2/3. Explain why such trajectories cannot intersect the 
X axis. The closed paths in Fig. 13 and certain (explain which) 
of the parabolic-type trajectories on cither side of the saddle 
points correspond to 0 <c < -o)^/20. Which of the trajectories 
of Fig. 13 correspond to c < 0? What values of c correspond 
to the separatrices of Fig. 13? 

4. Express (35) in terms of standard elliptic functions for each 
of the several ranges of the integration constant c. Also derive 
closed form expressions for the separatrices. 

5. Discuss the relationship between the phase-plane trajec¬ 
tories of Fig. 14 and the integration constant c in (40). 

6. Express (41) in terms of standard elliptic functions for each 
of several ranges of the integration constant c. Determine the 
least “oscillatory” periods and the least “rotary” periods of the 
pendulum motion. 

7. Derive (46) from (45). 

8. Explain in detail how a solution of (42) is constructed using 
(46). In particular, assume y = |/o for x = 0, and show how to 
determine the number of full rotations of the pendulum. 

9. The equation 

d^u , , , 

•51? + “ = *=“’ (ii) 
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where fc is a small positive quantity, appears in the theory of 
equatorial satellite orbits of an oblate spheroid, (w depicts the 
variations from a constant in l/r, where r is the distance from the 
center of the spheroid to the satellite, and i is an angular variable.) 
Discuss the phase-plane trajectories of (ii), and express the solu¬ 
tions in terms of standard elliptic functions. 

10. Discuss the phase-plane trajectories of the equation 

d‘X , a 

where each of a and 6 is a positive constant. Consider various 
possil)ilities in regard to the relative magnitudes of a and b. 
(This equation depicts, approximately, the motion of a magnet 
suspended by a spring above a large fixed iron plate.) 

11. Show that the phase-plane trajectories of the equation 

+ /(X) = 0 (iii) 

arc given by 

= c - F(j) (iv) 

where ^(.r) = 2 f(u) du and c is an integration constant. 

Kx])lain in detail how the phase-plane trajectories maj' he con- 
strticted from a plot of /'(.r) versus x. In terms of the geometric 
properties of the F curve, discuss singular points, periodic solu¬ 
tions, separalrices, symmetry of trajectories, extent of trajec¬ 
tories, etc. Illustrate by reference to the special cases of (iii) 
treated previously throughout this section. Discuss the integra¬ 
tion of (iv). 

12. Show that the phase-plane trajectorie.s of the damped 
system 

+ (V) 

.satisfy (iv) with c = co — 2k rj- dl, where co is an integration 

constant. Thus c i.< either nondecreasing or nonincreasing along 
a trajectory. I-^xplain how the trajectories of (v) for k 0 “cut 
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across” those of (iii). In particular, discuss the nature of the 
singular trajectories of (v) and show that periodic motion cannot 
occur 'i( k 7^ 0. 

13. Discuss the phase-plane trajectories of a simple pendulum 
with linear (viscous) damping. Refer to Fig. 14 and E.xercise 12. 

14. E.xtend the results in Exercise 12 to cover the general 
nonlinear second-order equation 

w" + ^ = « 

for which either yg(x,y,t) > 0 or yg{x,y,t) < 0 throughout. 
Illustrate by verifying the qualitative features of the trajectories 
of (42) as depicted in Fig. 15. 


3. The Initial-value Problem 


The phase-plane concept is introduced as the natural setting for 
formulating the initial-value problem. The initial-value problem 
for a second-order equation is as follows: Find a solution j(0 
which for t = /o satisfies 



In the phase plane, (47) specifies a point Pq = (xo.j/o), and the 
initial-value problem is that of finding a trajectory which passes 
through the point Po for I = io. For each system discussed in the 
previous two sections, there would be no loss in generality to 
assume that <o = 0 (i.c., we may choo.se to parameterize the 
trajectory so that t = 0 corresponds to Po). Clearly Po, in 
genera], is neither the beginning nor the end of a trajectory but 
merely a point on a trajectory. An important exception to this 
is the singular or point trajectory. For the systems discus.sed 
previously and for any point Po, the solution of the initial-value 
problem exists and is unique, whether singular or not. This is 
to say, if Pq = (xo,yo) is a point in the phase plane, there is one 
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and only one trajectory r, such that Fo is a point of F. For 
example, if Fo is a singular point of the system, then F consists 
of the single point Fo. One should note the important distinction 
made here between a trajectory as a parameterized solution of the 
differential system and as a plane curve which may appear to 
“pass through” a singular point. 

There are many excellent reasons for introducing the phase- 
plane, or w’hat we shall presently generalize to phase-space, con¬ 
cept. In the first place, every differential system treated is 
expressed as a first-order vector system and the treatment thus 
becomes unified. Pure geometric and vector concepts may be 
brought to bear at any time as an aid to the understanding of the 
algebraic and analytical processes. Further, all variables are 
treated on a par so that there is no artificial distinction made 
between the initial values of the various dependent variables. 
For example, the initial value of dz/di in (47) plays the same role 
in the initial-value problem as does the initial value of x. Indeed, 
the solution is here thought of as a pair of functions .r(0 and y(0 
for which z{to) = Xo and y{to) = yo, rather than as a single func¬ 
tion x{t) for which x = Xo and dx/dl = ijo w’hen t = U. 

One should note that the initial-value problem is fundamentally 
a “local” problem in the sense that it is concerned with a trajec¬ 
tory F near a single point, the initial point. To be sure, there are 
important questions to be answered in regard to the over-all 
nature of F, as to where it goes or from where it comes, but the 
foremost questions, those of existence and uniqueness, are each 
of a strictly local nature. 


EXERCISES 

1. Consider the system 
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with direction field 


dx 


y 

X 



The “solutions’' of (ii) are usually expressed in the form y — cx 
for arbitrary c. Explain why this is but a half-truth, and discuss 
the initial-value problem for (i). 

2. Discuss the initial-value problem for a system whose direc¬ 
tion field is given by a separable equation of the form 

N{x) dx — M{y) dy = 0 

3. Discuss the initial-value problem for a system whose direc¬ 
tion field is given by an exact equation of the form 

N{x,y) dx - Mix,y) dy = 0 (iii) 


4. Discuss the relationship between integrating factors of 
(iii) and parameterizations of the integral curves of the direction 
field dy/dx = N(x,y)/M{x,y). 

5. Consider the general second-order equation 

If r is a phase-plane trajectory of (iv) through the point Po, then 
express t as a line integral along the curve P in three diiTerent 
forms. Express (iv) as a system of two equations and use, in 
turn, each of the equations and then both. Generalize to a 
system with direction field given by (iii). 

6 . A boundary-value problem for (iv) might read: Find a solution 
of (iv) which satisfies the two linear relations 


dx 

aix + = <^1 for t = 


I 1. 

azx + Oj ^ = Cl 


for t = ti 



where each of oi, 61 , Ci, a^, 6 j, Ci, < 1 , it is given. For example, one 
might seek a solution x{t) which vanishes for / = 0 and t ~ 1 . 
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Rephrase the boundary-value problem (v) in geometrical terms 
with reference to the phase plane of (iv). 


4. Higher-order Systems 

The system (30) may be given the following vectorial interpre¬ 
tation. Let us define a column vector 


=0 


and, when x and y are differentiable functions of a scalar variable 
t, the derivative 


dx 

di 



Then (30) is equivalent to the vector equation 

— -Ax 
dt - 


where A is the 2-by-2 matrix 


-e t) 


and where denotes the usual row by column multiplication of 
a square matrix and a column vector. 

jNIore generally, if we consider an n-dimensional system 

dxi _ 

— ailXi -h QuXi + • • • -f OinXn 

dxz 


dt 


— ^21X1 -f a 22 X* + * • • + a^nXn 


dx, 

It 


— On\Xi H- an2X2 + ’ * • -j- a«„X„ 
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then with 



and 



one obtains the vector equation 




where now A is the n-by-n matrix 


an 

an 

• • • ai„ 

an 

• • • 

On 

• • • rtsn 

am 

am 

• ' • Onn 


(48) 


Equation (48) is the vectorial version of the most general linear 
homogeneous system of differential equations. The n-dimen- 
sional vector space is called the phase space, and a solution or 
trajectory is a space curve in the n-dimensional phase space. 


Example 1 


Consider the third-order equation 


We define 




and note that (49) becomes 

dxt _ xj Xi 3xj 

dt ~ 4 2 ~T 
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upon solving for the highest derivative. Hence (49) is equivalent 
to the third-order system 

dxi 

It ' 

dx^ 

"dT = (50) 

dxz _ _ ^ _ 3 ^ 

dt 4 2 4 


where the first two merely define the notation. The vectorial 
version of (50) is (48) with 



In three-space, the trajectories are integral curves of the system 

dxx ^ _ _ — dxa 

^2 X3 Xi /4 -J- X2/2 -j- 8x3/4 

This system defines a three-dimensional direction field where the 
vectorial direction at the point (xi, X 2 , X 3 ) is given by the direction 

Xj SxsX 

4 ” T/ 


numbers Txa, X 3 , 


Example 2 


The nth-order equation 


d^x 


+ b, 


d'*“'x 


d’'~^x 


df' ' di-i + ■ 

is equivalent to the vector equation (48) 


+ 61 X = 0 


with 
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0 1 0 . 0 ] 

0 0 1 0 . 0 

and 0 0 « 1 « . 0 


0 0 0 . 0 1 

.■ * ~K 

. 


Example 3 

Consider the following system of two coupled second-order 
equations. 





Let X = xi, dx/dt = xz, y = Xz, and dy/dt = x,. Then the 
system (51) is equivalent to the vector equation (48) with 

( 0 1 0 0 \ 

-1 0 2 -5\ 

0 0 0 I I 

3 0-1 -2/ 


Example 4 

The linear differential equation 

^ + “(0 ji + m X = /(o 


is equivalent to the vector equation 

f = +/(() 


where 

and 



provided 
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The vector equation (53) represents the most general linear 
system of dimension two. 


Example 5 

Consider once again Eq. (52). Let us define x = x\,dx/dt = xt, 
and t = xz. Then (52) becomes 

^ = -b{x3) xi - a{x3) Xi +/(X3) 


The right-hand side defines a single function of three variables 
Xi, Xi, and Xz, say 

/z(xi, Xi, Xa) S -5 (x3) Xi - a(xa) Xg -f/(xj) 

For completeness we define also two other functions 


/i(xi, Xi, X?) s Xi /afxi, Xi, xs) s 1 

Then (52) is equivalent to the system 


dxi 

dl 


= /i(xi, Xi, xa) 



= /j(ii, Xi, Xa) 
= Sz{xi, Xi, Xa) 


These equations are no longer linear in the three variables Xi, Xi, 
and Xa, but yet we may express the system vectorially in the form 

fi(x)\ 

m) 

Ui)/ 

Here we use the notation/t(x) = /t(xi, Xa, Xa) to denote a scalar 
function of three scalar quantities Xi, n, and Xa or w'hat is the 
same, to denote a scalar function of the vector x. On the other 
hand, /(x) denotes a vector function of the vector £. 


w’here 



and /(x) 
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The most general n-dimensional system we shall consider may 


be expressed in the vector form 

% = Ki,t) (54) 

where J (55) 

and 

Sk{x,t) = Sk{xi, Xi, ... k = \,2, . . . ,n (5C) 


The vector function (55) will be called the right-haml mi mhcr and 
generally will be a function of the independent variable t and the 
ft dependent variables Xi, xj, . . . , x„. The system (54) is 
linear if each of the scalar functions (50) is linear in each of 
xi, X 2 , . . . , x„. The initial-value problem associated with (54) 
concerns a solution of (54) satisfying x(fo) = c, for a given c and 
to. A solution vector function x(/) is called a trajedorg and 
defines, parametrically, a space curve in the n-dimensional space. 
A singular solution (or point solution) is a trajectory consisting of 
a single point c such that x(f) = c satisfies (54) identically in f (or 
possibly for to < t < to + 6, for some b > 0). Clearly, c must 
satisfy 

= 0 (57) 

i.e., the right-hand member must vanish identically for .f = c. 
A solution c of (57) is called a singular ■point of (54). singular 
point represents a state of equilibrium of the system. point 
of the phase space which is not a singular point of (54) is called 
a regular point. 

It may be shown that/i(xi, X 2 , . . . , x„, t) is continuous and 
linear in xi, Xj, . . . , Xn if and only if there are n -j- 1 continuous 
functions 0 * 1 , an, . . . , an, /* of t such that 

fk(xi, Xi, , Xn, t) = ajtiXi + OtjXa + • • • + QknXn +/t 

holds identically in Xi, Xj, . . . , x„, and t. Thus (54) is con- 
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tinuous and linear if and only if there exists a continuous matrix 
function of 



an(0 • • • ai„(0 

Oai (0 flaaC/) • ' * O2n(0 


a»i(0 UnsCO • • ■ O„n(0 


and a continuous vector function of t, 



such that= A (() x +/(i) holds identically in Xi, X2, . . . , 
Xn, and t. Therefore, the vector equation 


~ = ^( 0 x +/(0 


represents the most general linear system of order n. The matrix 
function A{i) is called the coefficient matrix, and the vector func¬ 
tion /(/) is called the forcing function. A linear system with 
constant coefficients is one for which the coefficient matrix is a 
constant matrix. A linear system with periodic coefficients of 
period t is one for which A{t -\- r) = A{t) holds identically in (; 
i.e., the coefficient matrix is periodic with period t. When the 
forcing function is zero, the system is said to be homogeneous. 

Ihe origin, i.e., x = 0, is a singular point of each linear homo¬ 
geneous system. 

When the right-hand member in (54) is independent of (, the 
system (or vector equation) is said to be autonomous. By adding 
one more dependent variable and one trivial differential equation 
(see Example 5), one may always construct an autonomous 
system which is equivalent to (54), By this artifice we unify our 
treatment, though there are instances in which one must insist 
upon retaining the nonautonomous form. 
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5. The Taxicab Geometry^ 

The norm of a vector x is defined as the scalar quantity 

|i|=Xk.i (58) 

t-1 

In analytical work, it is simpler to deal wdth the norm of a vector 
than with the more familiar Euclidean length 

\x\ = \/xi^ + Xt^ + • • • + 

On the other hand, the norm of a vector is clearly a measure of the 
magnitude of a vector, since 

a. IXI = 0 if and only if x = 0. 

b. lim IXI = 0 if and only if lim |x| = 0. 

In fact, this particular norm has been given the very descriptive 
name taxicab length or distance, since relative to this norm, dis¬ 
tance is accrued along rectangular (i.e. piece-wise rectilinear) 
paths. Distance in the taxicab geometry is that familiar urban 
measurement in “block" units. Property a merely states that 
points in n-space are distinguished by the norm. More generally, 
the distance (taxicab distance or, if you prefer, the number of 
blocks) from 



is the norm of the difference vector x — y; that is, 

n 

I X - y I = 2 |x< - y.[ 

(-1 

•The name is due to K. Menger, "You Will Like Geometry,” p. 5, 
Guidebook for Illinois Institute of Technology Geometry Exhibit, Museum 
of Science and Industry, Chicago, 111., 1952. 
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Thus by property a, x and y are position vectors to different 
points if and only if | x — y | 0. 

Property b states that the topology induced (defined) by the 
norm is equivalent to the familiar Euclidean topology. This 
may be illustrated by considering, a little more in detail, the two 
geometries. In Euclidean geometry, the equation |x| = 1 
defines the n sphere of radius one, centered at the origin. For 
n = 2, this is a circle. In the taxicab geometry, the analogous 
equation | x | = 1 defines an inscribed square (see Fig. 16). The 



points inside the circle satisfy the inequality |x| < 1, while the 
points inside the square satisfy the inequality |x| < 1. Of 
course, the latter also lie inside the unit circle. This is to say, if 
I x| < 1 then |x| < 1. On the other hand, there exists a circle 
of radius 5, less than unity (any radius 8 < l/y/2 will do), such 
that the interior of the circle of radius 6, centered at the origin, 
lies within the square (see Fig. 16). This is to say, if \x\ < 8, 
then |x| < 1, What is really important for the analysis is 
merely the fact that inside each circle is a square, and that inside 
each square is a circle. Thus the circle shrinks to the origin if 
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and only if the square shrinks to the origin. This is property 6. 
Other properties of the norm which we sliall need are: 


c. 



€. 


|i + i/|<|j| + |i/| (triangular inequality). 
I cx I = kl IX j where c is a scalar. 


1 lu I - 1 It' I I 


where 




We shall also have occasion to use the norm of a square matri.v 
A which we define similarly. 


I --11 = I | a.,l ( 59 ) 

1-1 


The following properties are easily verified. 


/. I I = 0 if and only if [ ^ = 0- 

t-1 

;-i 

u 

g. lim I /I I = 0 if and only if lim [ ^ («.>)‘]^ = 0. 

■ -1 
j-i 

h. \A +B|<|^| + |^| 
i\cA\ < |c| I /I I where c is a scalar. 

j. I Ax| < I A||x|. 

k. j^^|<U||^| 

where A{t) dt = (^j‘* a,>(0 dt)- 

We define limiting processes for vectors and matrices as one 
would expect. For example, 
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m. X = lim means: For each € > 0, there exists a positive 

integer K such that k > K implies 

I X — I 

n. y = lim x{l) means: For each e > 0, there exists a 5 > 0 

i-*u 

such that 0 < — <o| < 5 implies 

I y - Hi) I < e- 

Using properties m and n, and similar limit definitions for 
matrices, one can show that 


0 . lim x^*^ = X if and only if 



lim xi^*'’ 

it—• 

lim xi^*^ 

ife—* » 


lim x«^*^ 


it—f • 




r. 


s. 


f = lim m - m. 

at /,_< ti t 

d{AD) dA _ , .dB 

~dr ^ di ^ dT 


d(Ax) 

dl 

d(A-) 

dt 


dA . , 
dt ^ 


A dx 

‘w 




A->. 


6. ContinuouSy Differentiable, Analytic, and Ldpschitz 
Vector Functions 

A vector function J{x,t) of the vector x and scalar / is continuous 

in the paiT {x,t) if it is continuous in the n + 1 variables Xi, 

^ 2 , , x„, /. The word continuous in the above definition 

may be replaced, in turn, by the words dijfeTcntiahle and analytic. 

The latter might need some explanation. A function is analytic 
% 

in xi, X 2 , . . . , x„, < if it can be expressed as a power series in 
the n + 1 variables x,, xj, , . . , x„, t. 
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A vector function J(x,t) is a Lipschiiz function in x if there exists 
a constant m such that 

|/(^,0 - J(y,f)\ <m\x - y\ 

A number m for which the above is true is called a Lipsckitz 
constant. 

In the above definitions the ranges of the variables have not 
been mentioned. In most applications, each concept will con¬ 
cern a local characteristic of the function. It will depict a 
property of /(x,0 for a restricted (generally small) region of 
{x,t) space. 

Finally, we note that if /(x,/) has bounded first-partial deriva¬ 
tives in each of Xi, Xj, . . . , x„ (uniform in 1), then is a 
Lipschitz function. This follows from the mean-value theorem 
for functions of several variables. 

EXKRCISrS 

1. Show that/(xj, x^, , x„, t) is continuous and linear in 

ii, X 2 , . . . , x„ if and only if there are n -b 1 continuous func¬ 
tions aj, 02 , ... , On, fi such that 

/(xi, X 2 , . . . , x„, t) = OiXi -b 02 X 2 + • • • + a„Xn + fl 

holds identically in xi, X 2 , . . . , x„, and t. 

2. Using the definitions (58) and (59), verify the 12 properties 
of the norm, a through 1. 

3. Using the definitions m and n, verify properties o and p. 

4. Define the “double norm” of a vector x as the scalar 
quantity I!x|| = max (|xi|, lx 2 [, . . . , |x„|). Show that in two- 
space, the locus |Ix|[ = 1 is a square which circumscribes the 
circle |x[ = 1. Thus the double-norm equivalent of a Euclidean 
circle is also a square. The author is indebted to one of his 
students for suggesting the picturesque name squircle, a “square 
circle.” On the other hand, the orientation of the “single-norm” 
square | i | = 1 suggests a diamond, and so one might coin for it 
the name dircle, a “diamond circle.” Illustrate, by a sketch, the 
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geometric relationships between circles, dircles, and squircles, and 
show that lim \x\ - 0, if and only if lim | x | = 0, if and only if 
Urn |jx|I = 0. One might use the double norm in place of the 
norm or Euclidean length and obtain the same limit concepts. 
In fact, the double norm, typically, is the basis for elementary 
studies in analysis which are usually referred to as “advanced 
calculus.” Explain the connection. 

5. The continuous vector function/(x,0 is said to be linear in x 
if/(ax + ^y) = a/(x,0 + /9/(y,0 for all vectors x, y and all scalars 
a, /3, and t. Show that this definition of “linearity” is equivalent 
to that given for the right-hand member in (54). 

6. Show that /(x,0 is a Lipschits function if it is continuous in 
the pair (x,<) and linear in x. 

7. Give examples of continuous functions which are not 
Lipschitz functions. 

8. Give examples of Lipschitz functions for which “universal” 
(in contrast to local) Lipschitz constants exist. 

9. Under what circumstance may a linear homogeneous system 
possess a singular point other than the origin? In what sense is 
such a system degenerate? 



Chapter 2 


THE EXISTENCE AND THE 
UNIQUENESS OF A SOLUTION 
OF THE INITIAL-VALUE PROBLEM 


1 . The Cauchy-Lipschitz Existence Theorem 
{Method of Successive Approximations) 

The initial-value problem for systems of ordinary differential 
equations was defined in Chap. 1. Here we shall state and prove 
a few basic theorems concerning this problem, leaving the bulk 
of the interpretations and applications to subsequent chapters. 
Let R denote the subset of n-space consisting of all x satisfying 

|i-c|<a (1) 

where c is a point of n-space, a > 0, each fixed throughout this 
chapter. Let/(i) be continuous in R, and consider the following 
differential equation: 

ft = <2) 

We seek a solution of (2), subject to the initial eondition 

X — c for ( = 0 (3) 

which exists for t in an interval 0 < t < b for some 6 > 0, and for 

which X remains in R. We shall call this the forward problem. 

41 
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In the backward problem one seeks a solution on an interval 
— b<t<0 for 6 > 0. However, replacing f by — < in (2) con¬ 
verts a backward problem to a forward problem with the right- 
hand member —/(x). Thus it is sufficient to direct all our 
attention to the forward problem. We remark that there is no 
loss of generality in assuming that the initial value c is given for 
I = 0, nor that (2) is an autonomous system. The forward 
initial-value problem is equivalent to the problem of finding a 
solution of the integral equation 

x(t) = c + Kx(s)) ds (4) 

for 0 < / < 6. The latter, however, is more amenable to analysis. 

It is instructive to consider a solution of (4) as a fixed point of 
a Iransforination. To this end, we define, for each continuous 
vector function x(t) (defined on 0 < ( < 6, with values in R) the 
transform 

T{x) = c -f- J{x{s)) ds (5) 

Then y = T{x) (6) 

is a continuous (vector-valued) function of t and for sufficiently 
small t remains in R. Since the function J(x) is continuous, it is 
necessarily bounded in R. Hence let K be such that 

|/(^) I < K (7) 

for carh f in R. Then from (5) and (0), we obtain 

I 5 - f I = I -c\< j' |/(x(s)) I ds < (8) 

so long as .rfs) is in R. If we let 

^ ^ (9) 

then (8) implies that | y - c | < a for 0 < ( < & so long as x 
satisfies I i' — c I < a for 0 < ( < 6. This is to say that the set 
•S, consisting of all continuous functions x with values in R for 
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0 < < < 6, is mapped into itself by the transformation (6). iS is 
called an invariant set of the transformation. A solution of the 
integral equation (4) is a fixed point of T, i.o., a solution of 
X = T{x), and clearly belongs to S. If it can be shown that there 
exists at least one fixed point of T then a solution of the initial- 
value problem exists. If T possesses exactly one fixed point, the 
solution of the initial-value problem is unique. 

It is typical in fixed-point problems to consider iterative pro¬ 
cedures. One selects some member of S (arbitrarily), say 
and defines recursively 

• • ■ 

The sequence x^°\ . . . generally wanders about in S and 

may or may not “converge.” Numerous devices might be 
employed to increase the chances of convergence, improve on the 
starting point average at each step or over several .‘^tops, etc. 
In the present case, the iterates are known as successive approxi¬ 
mations, from which the process receives its name. Typically, 
one chooses as a first approximation x'®’ = c, i.e., the constant 
initial value itself, although this is not essential and often 
represents a very poor over-all approximation. We have the 
following important theorem. 

Theorem 1 

Let x^®^ be in S, i.c., let x^°^ be continuous and satisfy 
|x“» — c| < a for 0 < t < b. For ^: = 0, 1, . . . define (by 
induction) 

^{t+u = = c -{- /(xf*>(s)) ds (10) 

If /(x) is a Lipschitz function, i.e., if there exists a constant 
such that 

|/(^) -/{S)| <m\x~y\ (11) 

for ^ and y inthen the sequence x^®^ x”*, x^*’, . . . converges 
to a solution of the initial-value problem (2), (3). 
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Proof: First we note from (10) for = 0 that 

x(i) - = c - x«» + ds 

and so by (9), 

I I < I c - I + |/(xt“>(5)) \ds<a-\-Kt<2a 

(12) 

for 0 < / < 6. From (10) for A; = 1, we obtain 
_ ^C 1 >| = |^‘/(^‘"(s)) ds - rfs| 

^ folKx^Hs)) -Kx<’^Hs))\ds 

Since each of x”>(s) and x<''>(s) is in i? for 0 < s < b, we have, 
using (II), 

I x<=> — x‘** I < m I x‘*Ks) — xf»(s) I ds 
which, together with (12), yields 

|x(2> - x“>| < my^'2arfs = 2a(m0 (13) 

for 0 < / < 6. More generally, we have for k > 0 
I £.«,+» _ I 11^' _ /(x«-I)(s))) rfs| 

^ /„'|/(-8"(s)) -/(x“->(s))|* 

and since each of x'*>(s) and x(*-»(s) is in 7? for 0 < s < b, we 
lun-e, using (11), 

- x«) I < m |^'|x<*>(s) - x«-*Hs) Ids (14) 
for 0 < ^ < 6. Now if 


I < 2a 


(15) 


for 0 < / < 6, then 


I i<‘+» - x<‘. I < f s*-. ds = 2a 

Jo \h ~ i) I Icl 


( 16 ) 
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for 0 < i < 6. But (16) is (15) with k replaced by /: + 1 and 
since (13) is (15) for k = 2, we have (by mathematical induction) 
that (15) holds for all k > 2. Now for A* > 2, / > 0 we have 


I I 

=I 


<1 




^(t+/-l> I _j_ I ^(k+l-l) 


. . . ^ — jf*) I 




+ |i(i+l) _ jUi] 


which, together with (15), implies that 


\x 


r(k+l) _ r(*) 


I < o-f 

[{k-\-l- l)]~^ (k + l-2)\ 


+ 


+ 


< 2a 


r(m6)‘ (m5)‘+‘ 

[ A:! (A:+ 1)! 


+ 


■1 


(mty 

k\ 


(17) 


< 2ac”''' 


(m6) 

A-! 


for 0 < ( < 5. But lim j^2ac'^^^^j = 0, and so (17), in 

turn, implies that the sequence i*®’, . . , converges 

(in the sense of Cauchy) uniformly on 0 < < < 5. Clearly then, 
if we denote by x the limit, we have from (10) 

X = lim = c + lim [‘ J(x^'‘Hs)) ds 


= c4- f‘j{\ixn i«'(s))(/s 

= C + /o* I(Hs)) ds (18) 

since the convergence is uniform for 0 < < < 6, and /is uniformly 
continuous. Thus the theorem is proved. 


EXERCISES 


1. Demonstrate the equivalence of the initial-value problem 
(2), (3), and the integral equation problem (4). 
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2. Justify (18) by establishing the inequalities 

^(*+ 1 ) _ c - /(x(s)) ds I < l‘ |/(i^«(s)) - Km) ! ds 

3. In the notation of Theorem 1, let 6i = min| 6 ,ij and 

\ 

0 < 62 < bi. Then show that 


|x'*+«(() — < (j^ max I 

y>l/ 0<a<bi 

for 0 < t < b 2 , and hence 

max |^(‘+»(0 - x<*>(0 I < max |i<‘>(s) - x(*-i>(s) I 

0<(<bt \®V 0<«<6* 


Explain why this implies that 

max |x«+*>(/) - I < 2q 

0<f<6, \^V 

and that the sequence x^*\ . . . converges uniformly 

for 0 < i < bz. 

4. Show that the transformation T given in ( 6 ) is “continu¬ 
ous.” Take as the domain of T the set S with the uniform 
topology, i.e., lim x<*> = x in 5 means lim x‘*H 0 = ^(0 uni- 

«0 M 

formly for 0 < t < b. Then T is contimwus if lim x*^^ = x 

it—*« 

implies lim r(x‘*’) = ^(x). 

it—► ® 

5. Using Exercise 4, show that the limit of the sequence of 
successive approximations of Theorem 1 is a fixed point of T. 


2. The Uniqueness Theorem 

Theorem 2 

With the hypotheses of Theorem 1, the solution of the initial- 
value problem is unique. 
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Proof: Suppose each of x and I is a solution of the initial-value 
problem. Then 

X = c + Jix{8)) ds and z = c + J{z{s)) ds 

for 0 < / < 6. Hence, subtracting, we have 
I x(0 - 2(0 I < I /(x(s)) - /( 2 (s)) \ds<m l^\ i(s) - 2 (s) | ds 
where m is a Lipschitz constant. The scalar function 

4.(0 = I m - s{t) I 


thus satisfies the inequality 

^*(0 < c + m ^(s) ds 

for every c > 0. On the other hand, (19) may be written 


(19) 




c + m 4'(5) ds 


< 1 


and, since 4>(0 is continuous, 




1 


This in turn implies that 

c -|- m $(s) ds 


In 


< ml 


for 0 < t < b, and hence 

c -b m <I>( 5 ) ds < cc"' (20) 

Using (19) and (20), we have finally 

4)(0 < ce"* (21) 

for 0 < t <b. Since (21) holds for every c > 0, necessarily 
^(0 = 0 or, what is the same, i(0 = HO for 0 < t < b, which 
was to be proved. 
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3. Continuity with Respect to Initial Values 

Because the treatment is so similar to that of the previous 
theorem, we now consider an important result which properly 
belongs in the following chapter. 

Theorem 3 

Uith the hypotheses of Theorem I, the solution of the initial- 
value problem is a continuous function of the initial vector. 

Proof: We obtain an upper bound to the growth of the differ¬ 
ence I x{t) - y{t) I as a function of t, for any two solutions x and y 
of the imtial-value problem corresponding to two initial vectors 
c and (■*, respectively. In fact, from 

■«(') = Km) ds and m = C» + ds 

we have 


I m - m I < I c- - f• I + - /(y(s)) I ds 

or, upon u.«^iiig (11), 

I KO - 0(1) I < I c - f I + m /„' I m - m I ds (22) 

The incciuality (22) is of (ho form (19) with <P(t) = |x(0 - m) I 
andc = |f-r.|. Thus hy (21) wo have 

I — y(t) j < I c — c* I c”' (23) 

Clearly, (23) implies that the solution of the initial-value problem 
IS a continuous function of the initial vector. 


r-AhitCTSKS 

1. That (19) implies (21) is a version of Gronwall’s lemma ‘ 
. Ulistandate the following version. If 4. and are nonnegative 

of llu.' s,‘ l "" ‘l’<' I'erivativcs with Respect to e Parameter 

voi. 20: *'T.atio„s, ..i„„, sec. 2, 
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continuous functions satisfying the inequality 4>(0 < c + 
4>(s) V'(s) ds for t > 0, then it follows that 

4'{/) < c exp (^(s) (fs) 

for t > 0. Rephrase the lemma in terms of an initial-value 
problem for a differential inequality. 

2. Prove Theorem 2 by showing that for any sequence 
of successive approximations (10) and for any I satisfying 

z = c + J{z{s)) ds 

we have lim ” HO \ = 0, uniformly for 0 < / < ^>. 

(k—• • 

3. Reformulate Theorem 3 abstractly in terms of tlio function 
space S with the uniform topology. 

4. Consider the transformation (6) as a mapping T from a 
product space consisting of pairs of constant vectors c and func¬ 
tion vectors x{t). Reformulate Theorems 1 and 2 abstractly in 
terms of T and the natural projections of the product space into 
the two coordinate spaces. Illustrate b}”^ a sketch. If the family 
of solutions of (4) is interpreted as a ‘‘curve/’ x versus c in the 
product space, what property of this curve is prescribed by 
Theorem 3? 

4. The Cavchy-Peano Existence Theorem 

The existence of a solution to the initial-value problem (2), 
(3) may be established without recourse to the Lipschitz property. 
However, if the right-hand member of (2) is not a Lipschitz 
function, in general more than one solution may exist. For 
example, the initial-value problem dx/dt - x^‘\ x(0) = 0 admits 
the trivial solution in addition to x = <V4. In the proof of 
Theorem 1, we define a sequence x‘*’, . . . of succe.'isive 

approximations by an iterative procedure. Upon imposing the 
Lipschitz condition (11) we are able to show that the sctiuonce 
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converges uniformly for 0 < / < 6. From this it follows that the 
limit of the sequence is a solution of the initial-value problem. 
When the Lipschitz condition is dropped, we can no longer guaran¬ 
tee that the total sequence converges, but by recourse to a funda¬ 
mental theorem from real variable theory, we could assert that a 
properly chosen subsequence of the iterates is uniformly con¬ 
vergent on 0 < ; < 6. The theorem of Ascoli states that if 
^( 0 )^ ... is an infinite sequence of uniformly bounded 

equicontinuous functions on 0 < ; < 6, 6 > 0, then there exists a 
subsequence which converges uniformly on 0 < ( < &. In the 
present case, each of the satisfies: 

a. < |c| + a forO < ( < 6. 
and 

b. I I < K\U - U\ forO <t,<b ,0 <t,< b. 

Ihe first asserts that the sequence is uniformly bounded, and the 
second, that the family of functions is equicontinuous (K is inde¬ 
pendent of h, ta, and k). Thus by the Ascoli theorem, a subse¬ 
quence is uniformly convergent for 0 < ( < 6.* However, the 
limit need not be a solution of the initial-value problem (2), (3). 
i hu.s we are forced to consider a sequence of approximations 
which are inlierently more closely tied to the integral equation. 
We consider a proof of the Cauchy-Peano existence theorem 
(Theorem 4) using a discrete analogue of (2). As might be 
anticipated, the Ascoli theorem plays a central role, and our 
principal objective will be to construct a uniformly bounded 
sequence of equicontinuous approximations to a solution of (2). 
In this instance, however, the approximations are supplied by 
difi'erence etiuations rather than by an iterative procedure. A 
uniform limit of these approximations will furnish a solution of 
the initial-value problem (2), (3). For the sake of simplicity, we 
shall treat only the scalar case, n = 1. 

■ See Exercise 12 for a proof based directly upon properties a and 6. 
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Consider the scalar equation 

^ = /(I) (24) 

and the initial condition 

x(0) = c (25) 

where f{x) is continuous and bounded for |x — c| < a. Let 
|/(x)l < K for \x — c\ < a, and let b = a/K. Tor k = I, 
2, .... let (t = b/k, so that 0, 4, 2^, .... (A* - l)(t, = 6 

subdivides the interval 0 < < < 6 into k equal parts. For k fixed, 
we solve the explicit-difference equation [analogue of (24)) 

xiU + IXt) - x(jl,) ^ )) j = 0. 1, .... A - 1 (26) 

subject to the initial condition x(0) = c. Denote by j-/ the value 
of xfor t - jtk. Then (26) is equivalent to 

= x/ -h tkfix /) j = 0, I. . . . , A - 1 (27) 

with xo‘ = c. Let x‘(0 be the polygon connecting the points 
{jtk, x/) fori = 0, 1, . . . ,k (see Fig. 1). We wish to show that 



Figure 1 

the family of polygons x‘(0 consists of uniformly bounded equi- 
continuous functions. The arguments are analogous to the con¬ 
tinuous case. In fact, 

[i/ — c| < (b) max |/(x)| <hK = a for all k and; 

\s-e\^a 
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This follows easily from (27) and the definition of the quantity 6. 
On the other hand, if 0 < i < 6 and 0 < t < 6, the slope of the 
secant between t and r (see Fig. 2) does not exceed K > max |/(x)| 
for any polygon. That is, |a:*(T) - x*(0| < K\t - t\, where K is 
independent of t, and k. Thus by the Ascoli theorem, there 
exists a subsequence x'', x'*, ... of the polygons which is 
uniformly convergent to, say, x on 0 < ^ < 6. 

In contrast to the continuous case where it was shown that the 
uniform limit was a solution of an equivalent integral equation, 



let us here show directly that the uniform limit is a solution of the 
difTerential equation (24). With reference to Fig. 2, if it, < t 
and r < we have 


mill /(Xr'») < 

i<r<j 


x‘'*(r) - x**(0 

T — t 


< max/(xr'*) 

*<r<} 


(28) 


This states that the slope of the secant between t and r lies 

between the minimum and the maximum of the slopes of the 

segments of the »/*th polygon between it, and jt,. On the other 
hand, 

min /(x^(s)) < min /(x,'*) 

i<r<> 

max /(Xr'*) < max /(x-*(s)) 


and 
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since the continuous variables in each case cover larger sets than 
the discrete variables. Hence (28) implies that 

min /(j:'*(s)) < ^ /(a''*(s)) (29) 

If we now assume (as implied in I'ig. 2) that i(,^ is always the 
nearest j^t-subdivision point to the left of t and is always the 

nearest i^i-subdivision point to the right of t, then with k—> x 
(i.e., Vk^ «), —* I and jt,^ —» r. At the same time, j'*(0 —► 

x{t), x'*(t) —* x(t}, and x^(s) —» ^(s), the latter uniformly for 0 < 
8 < b. Thus since/(a:) is uniformly continuous, (20) implies that 

min f(x(s)) < < max fix(s)) (30) 

f<«<r T — t l<i<T 

From (30) in turn, we have 

lim ~ = f(xU)) (31) 

r-t< f ~ i 

and this shows that x(0 is both differentiable and satij^fies (24). 
Of course, .t(0) = c since x'*(0) = c for each k. Thi.-^ completes 
the proof for the scalar case of the fundamental theorem 4. 

Theorem 4 

If the right-hand member in (2) is continuous in a neighborhood 
of an initial point c, then there exists a solution of the initial-value 
problem (2), (3). 


EXERCISES 


1. If 0 < a < 1, show that the initial-value problem 



x(0) = 0 has infinitely many solutions. In fact, show that for 
any c > 0, there exists a solution satisfying x = 0 for 0 < t < c 
and X 0 for c < t. Note that the right-hand member is con¬ 
tinuous, but is not a Lipschitz function near the initial point. 
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2. Generalize Exercise 1 by considering the initial-value 
problem dx/dt = /(x), x(0) = 0 with/(x) continuous and positive 
for X 0 and /(O) = 0. Show that if dx/f{x) has an intcgrable 
singularity at x = 0, then the initial-value problem has infinitely 
many solutions. 


3. Show that the initial-value problem dx/dt = x In |x|, 
x(0) = 0 admits only the trivial solution by considering the 
integrability of dx/x In x near x = 0. On the other hand, show 
that the right-hand member is continuous at x = 0 (define the 
value of the right-hand member appropriately for x = 0) but is 


not a Lipschitz function near x = 0. Explain the significance 
of such an example. 

4. Generalize Exercise 3 by showing that the initial-value 
problem in Exercise 2 has a unique solution if dx/J{x) is not 
intcgrable at x = 0. 

5. Extend Exercise 4 by considering the vector equation 
dx/dt =J{x), for which the right-hand member satisfies the 
inequality | J{x) ~ J{y) | < /(| .f — y |), with /(x) continuous and 
nondecrca.sing, /(O) = 0 and /dx//Cx) divergent at x = 0. 
Explain how this includes the Cauchy-Eipschitz case, Theorem 2. 

C). 'N'erify the properties a and b of this section. 

7. Show by example that the limit of a uniformly convergent 
subsequence of successive approximations need not satisfy the 
integral eciuation (4). 

8. J‘,xplain in detail wliy (30) folh)ws from (29). 


9. Show that tin* limit of tlie uniformly convergent subseq 
of polygonal approximations xn satisfie.s the integral equati 


lienee 
ion 


^■(0 - ^ + /o /(x(s)) ds. 


10. Prn\e the Cauchy-Peano existence theorem for two- 
dimensional systems (n = 2) using approximations supplied by 
difference equations. 

11. Kephrase 1 heorem 4 for nonautonomous systems. 
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12. Let each of the vector functions = 1, 2, ... be 

defined on 0 < i < 6 with 6 > 0. UK and L are positive con¬ 
stants satisfying 

I MO \<L and | | < AH/i - /;) 

for all fc = 1, 2, . . . and t, h, U in the interval 0 < / < 6, then 
one may show that a subsequence of the Xi(0 is uniformly con¬ 
vergent on 0 < / < 6. In fact, if we first arrange the rational 
points of the interval 0 < I < 6 in a sequence T], t:, . . . , then 
from among the xt(0 we may choose a subsequence 
j = 1, 2, ... so that lirn xij{ri) exists. Why is this po.ssible? 

Then from among the 've may choose a sub.<equcnce X2j(0, 
i = 1, 2, ... so that lim xj/rz) exists. Continuing, we choose 

subsequences in such a fashion that for each po.sitivc integer i, 
^•■>(0* y “ 1, 2, ... is a sub.scqucnce of the sequence 
i = 1, 2, . . . and lim j,;(r,) exists. Show that this is indeed 

possible and that the subsequence in(0, ^22(0, • • • converges 
at each of the rational points of the interval. This is called the 

dfagona/wafion proem since the subsequence x,.(0, f = 1,2, . . . 

consists of the diagonal elements of the infinite matrix (x,;,). 

Now if e > 0, one may divide the interval 0 < t < 6 into a finite 
number of subintervals each of length less than c/3A'. Interior 
to each subinterval we choose a representative rational point r*. 
Show that there exists a positive integer K such that i > N and 
j > N imply |x.i(r*) - Xy>{r0 | < </3 for each of these finitely 
many r*. Thus for such i and j and for any t in 0 < t < 6, one 
has (why?) 

I XiiiO - £d0 1 < I xuiO - Mn) I + I x.,(r*) - xain) \ 

+ I £ji(rk) ~ xjiil) I < « 

with an appropriate choice (which?) of r*. Explain how this 
proves the desired result. 

13. Prove the theorem of Ascoli. 
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5. An Existence and Uniqueness Theorem for 
Nonautonomous Systems 

There are many circumstances in which one needs to relax the 
h 3 'pt)theses in Theorems 1, 2, and 4 with reference to the inde¬ 
pendent variable. In such a situation, one is concerned with a 
nonautonomous system 

§ = K£,t) (32) 

for which the right-hand member/(x,0 as a function of i is con¬ 
siderably less regular than it is as a function of the dependent 
variables a*i, xj, . . . , .r„. The artifice of introducing an 
auxiliary variable .Tn+j = t and therebj'’ rendering (32) autono¬ 
mous, throws (32) into the realms of Theorems 1, 2, and 4 but 
unnecessarily restricts the applications. Very often the diffi¬ 
culties are encountered only for an instant, say t = 0, where the 
right-hand member in (32) diverges. If the corresponding 
singularity is integrable, however, the difficulties are merely 
superficial. A companion to Theorems 1 and 2 for the non¬ 
autonomous case is Theorem 5. 

Theorem 5 

Let be continuous in x and / for |x — < a and 0 < 

t < b. Further, let/(x,0 sati.'^fy the inequalities 

|/(jV)| < A'(0 (33) 

and lAi,/) - /(5,() j < ,„(() | x - g | (34) 

for I X — c I < a and 0 < t < b, where each of A'(0 and m(i) is 
integrable on 0 < ( < 6. Let 6i(0 < 6i < 6) be chosen so that 

//‘ K{t) dt < a, 
di = 5 < 1 


and 


(35) 

(36) 
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Then if is continuous, with — c | < a for 0 < ^ < 6j, 
and 

= c + 5) ds (37) 

for fc = 0, 1, 2, , the sequence . . . converges 

uniformly on 0 < i < 6i to a unique solution x of the integral 
equation 

x(l) = c + J{x(s), s) da (38) 

Proof; From (33), (35), and (37) it follows that 

I x«+‘' - c I < s) I & < K(t) dt<a 

for 0 < f < 6j, provided 

- i\<a (39) 

for 0 < ( < hi. Thus since (39) is true for A = 0, it is true for all 
k. Now 


|i“* - iC 0 )| <|^_ x<°^\ + l^\Jix<^'(s),s)\ds < a 

+ K(t) dt < 2a 

for 0 < < < 6i, and so 

|x<« - I < U/(x<‘ns). S) - /(X'®>(5), a)\ds 

< m(s) I x”Hs) - x<®>(«) I da < 2a m(«) da < 2a5 


More generally, 

I _ iik) I < 1^' I I (40) 

and so if 

|^(t, _ i(*-n| < 2a3‘-i 

for 0 < ( < 6i, then 

|fCt+n _ f(t)| < 2a5*-‘ ni{a) da < 2aa* 


( 41 ) 
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for 0 < < < bi, which is (41) with k replaced by & + 1, Thus 

since (41) is true for A: = 1, it is true for all fc > 1. 

Now for A: > 1 and 1 > 0, we have 

I ^Ci+o _ x<« I < I I + I - x^k+i~zy | 

+ • • ■ + - x<*> I < 2a(5*+*-» + 5*+*-* + • - • + 5‘) 

= 2a6*(l + 5 + 52 4. . . . gi-i) (42) 

Owing to (36), the last factor on the right in (42) is bounded by a 
convergent geometric series whose sum is 1/(1 — 6). Hence 

|i(*+i) _ i(*) I < 2a5V(l - 5) 

for 0 < < < 61. But lim 2a5V(l — 5) = 0, and so the sequence 

«» 

^(0)^ ^(1)^ ^(2>^ converges uniformly on 0 < t < 6|. It is not 
difficult to show that the uniform limit, say x, satisfies the 
integral equation (38). In fact, using (34) and (36) we have for 
A; = 1, 2, , 

1/0 - Jq s) ds j 

< f m(s) |x(s) — x**>(s) |ds < 5 max |x(s) — ^‘*>(5) I 

for 0 < i < 61, and so 

/o*/(^(s)» s) ds = lim f ‘ J{z^’‘Ks), s) ds 

h * *0 ^ 

= lim [x^*+*>(0 — c] = x{t) — c 

A—* «0 

for 0 < t < bi. 

Uniqueness follows immediately from (36). In fact, if 

X = c + /(x(s), 5) ds and z ^ c Jms), s) ds 

then \x — z \ < m{s) \ x(s) — 2(3) | ds (43) 

Thus if A is the maximum of | x{t) — z(l) | for 0 < « < bi, then 

I x(0 — z(t) \ < A m(s) ds < A8 

holds for 0 < t < bi. Hence A < A5 which, in view of (36), is 
impossible unless A = 0. 
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EXERCISES 

1. Solve the initial-value problem dxldt - •r(O) = 1. 

Illustrate each detail of the statement and the proof of Theorem 
5 for this special case. Consider the initial condition a:(0) = 0. 

2. Show that the initial-value problem dx/d< = 2x//^ j(0) = 0 
has infinitely many solutions. What hypotheses of Theorem 5 
are not fulfilled in this case? 

3. Show that the initial-value problem = 0 

has infinitely many solutions. What hypotheses of Theorem 5 
are not fulfilled in this case? 

4. Show that the initial-value problem dxjdl = Hx-, x(0) = 0 
has a unique solution. Explain the significance of such an 
example. 

5. Generalize Theorem 5 to cover initial-value problems for 
arbitrary initial times ^o. 

6. Using Gronwall’s lemma and (43), prove that the solution x 
of (38) is unique. First extend Gronwall’s lemma so that it 
applies to integrable (but not necessarily continuous) functions. 

7. State and prove a companion to Theorem 3 for the non- 
aulonomous system (38). 

8. Prove Theorem 5 in the .scalar case, n = 1, using a sequence 
of approximations supplied by difference equations. 



Chapter 3 


PROPERTIES OF SOLUTIONS 


1. Extension of the Trajectories 

Tho existence theorems of Chap. 2 concern a solution of the 
initial-value problem 

= J{x) x(0) = c (1) 

for a certain interval 0 < / < 6 of the independent variable. If 
the right-liand member of the system is a Lipschitz function, then 
the solution is unique. As we proceed along a trajectory x{t) 
from its initial position c, we encounter, for each ti satisfying 
^ ti < h, points 5(ti) of 7J-space each of which may be con¬ 
sidered an appropriate initial position for a new initial-value 
problem. In general, the t interval of existence increases 
indefinitely (i.e., the trajectory beginning at c exists for all t > 0) 
or we arrive, for i = /j, at a position c* such that the initial-value 
problem for t t 2 with initial value x(fa) = c* has no solution, 
or a component of the solution 5(() diverges as / —»< 2 - For 
example, the initial-value problem dx/dt = 1/(1 - x), x{0) = 0 
leads to the trajector}'- x = 1 — V" 1 ~ 2f, which arrives at the 
point X = I for i = cannot be continued for larger t, 

wliile the initial-value problem dx/dt = x\ x(0) = 1 leads to the 

trajectory x(0 = 1/(1 — ()i which is mapped out completely with 

60 
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0 < < < 1. On the other hand, if lim x(0 = c* exists and f(x) 

f —<1 

is ccntinucus rear c*, then a solution satisfying xito) = c* exists 
on some interval (2 < I < i2 + "ith 61 > 0 and the latter 
bcccrres an extension of the former. Thus if one considers only 
systems vhich arc continuous throughout, then a solution x(0 of 
an initial-value problem may be continued for alW > 0 or a com¬ 
ponent diverges as < —♦ with 0 < /: < • 

In this chapter and subsequent chapters, the word trajectory 
will generally connote the unique solution of an initial-value 
problem (forward and/or backward) and all possible (unitjue) 
extensions for i > 0 (and/or t < 0). That portion of a trajectory 
mapped out for < > 0 will be called a positive half path, and that 
portion mapped out for f < 0 will be called a 7icgative half path. 
If a positive half path approaches a finite point c as ^ «, then c 

is necessarily a singular point. In fact, if /(c) 0, then |/(i) | 

is bounded away from zero for x near c and clearly if lim i(0 = c, 

at least one component of the integral Jix(s)) ds diverges as 

/ CO. But for a trajectory, the difference 2(0 - Jix{s)) ds 

must be constant, which is impossible. On the other hand, if 
each initial-value problem admits but oi^c solution, then a posi¬ 
tive half path can approach a singular point only for 
More generally, we define the positive limit cycle of a trajectory r 
as the set of those points which arc near r for i -♦ «>. We shall 
be more precise: Let c belong to r, and let 7 (e) denote the positive 
half path associated with the initial value c. Then the positive 
limit cycle of r is the intersection of the sets of limit points of 
y{e) as e varies on T. It is not difficult to sliow that a point 6 
belongs to the positive limit cycle of r if and only if the trajectory 
intersects each neighborhood of b for arbitrarily large values of t. 
Typically, a limit cycle is a singular point, a closed trajectory 
containing no singular points (corresponding to a periodic solution 
of the differential equation), an empty set (i.e., nonexistent), or a 
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collection of singular points and connecting paths called sepa- 
ratriccs. The first two, singular points and periodic solutions, 
are the limit cycles of principal concern in this book. 


2. Continuity Properties of Trajectories 


A solution x{i) of the initial-value problem (1) is continuous 
in t, i.c., the trajectory is an arc in xi, x^, t space. In 

fact, x(t) is continuously differentiable in t so that a nonsingular 
trajectory possesses a continuously turning tangent and its arc 
length is always defined. More generally, if the system possesses 
A'th-oidcr continuous derivatives, then a solution x(f) possesses a 
a {k 4- l)st continuous derivative with respect to t. 

According to Theorem 3 of Chap. 2, the solution x(t) of (1) is a 
continuous function of the initial vector c. This follows also 


from the fact that x{/) is the uniform limit of a sequence of func¬ 
tions each of which is a continuous function of the initial vector c. 
The latter argument employs a powerful tool which permits one 
to "tran.'^fer’' a property of approximates to a solution. We shall 
have use of it again. But for the moment, let us generalize these 
important continuity properties. 


By introducing auxiliary dependent variables, one shows that 
the solution x(t) of the initial-value problem is a continuous func¬ 
tion of any parameters which affect the S 3 ^stem in a continuous 
fa.‘=inon. In particular, if /(x) = .is a continuous 


vector lunction of \hc j scalar parameters ai, az, ... , aj, then 
one adjoins to the vector x, j components x„+ 2 , ■ . - , Xn+j 
and to the differential system ( 1 ), the 7 equations 


dx„+i 

= 0 

(it 


= 0 

dt 

A ^ A 

dXn^j 

dt 

• • • 

= 0 
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subject to the initial conditions 


a:„+i(0) = or, 

J^<i+2(0) = 02 


a:n+>(0) = o, 

By this artiBce, the parameters oi, 02 , . . . , oy appear as “initial 
values” of the (n 4'i)th-order system. The enlarged system is 
certainly continuous if (1) is, and the extended solution thu.'i 
becomes a continuous function of the parameters oj, 02 , . . . ,a,. 
The application of the technique used in the proof of Theorem 3 
of Chap. 2 yields an upper bound to quantitative effects of 
variations of these parameters. 


Example 1 

Consider the linear second-order equation 

d^x dx 

+ + = 0 (2) 


where A: > 0, w* > 0, and the initial values x = xo, dx/dt = j/o for 
I — 0. Introduce the components x, = x, X 2 = dx/dt, x, = k, 
and X 4 == «*. Then (2) is equivalent to the system 


dx\ 

~dt 

dx2 

dt 

dxi 

dt 

dxj 

dl 


X2 


-X4X1 - X3X2 




where the initial values become x, = xo, Xz = t/o, xz = k, and 
X 4 = Now (3) satisfies the Lipschitz condition 

l/(^) - Jiy) I = 1^2 - y^l + - y*yi — yty^l 

= \x2 - J/2I + |j 4 (xj - yi) + Xiixz - yt) ~ yi(y* — xt) 

- Viiyz - xj)| < ix4| |xi - yi! -H (1 + lxj|)|x3 - yzl 

+ li/2| 1 ^! - yi\ + \yi\ \^* ~ y*\ < m(|x, - yj| + \x2 - yz] 

+ \xz - yz\ + |x4 - y4!) *= m IX - y I 
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provided 

lx 4 | <m (1 + Ixal) < m |i/£[ < m and |j/,| < m (4) 

If we define “neighboring" initial values 2/. = xo, yj = 2 /o, 2/3 = 
and 2/4 = w* for a neighboring solution y = yi and denote by 



the corresponding vector solution, then from Eq. (23) of Chap. 2 
we have 

|x - y I = !xi - )/i| + lx- - J/al + \X3 - yz\ + 1.T4 - 1 / 4 I 

= U - y\ + \^ - ^\ + \k - k,\ + - 0,3,1 

< I C — C* I C"^ = (jfc — fc*| + Iw’ — wiDc"** 

or, what is the same, 

lx - i/I + 1^ - ^1 < (|fc - fc.l + |0,= - o,il)(x- - 1) 

The Lipschitz constant in may be any number which is an 
upper bound to the values of the quantities 1 + |A:|, and 
V^xo* + (?/o/w)'^ to be considered. Such a choice for m guarantees 
that the four inequalities (4) will be satisfied along any two trajec¬ 
tories X and y; i.e., the trajectories under consideration remain in a 
region for which the Lipschitz condition 

I /(x) - Ky) I < m IX - y I 

is satisfied. 

* 

Examplk 2 

Consider the Mathicu equation 


~ + (w- + t cos t)x - 0 


(5) 
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where each of oj* and « is u constant. For e = 0, each solution of 
(5) is a simple harmonic function of frequency w 

}j(t) = cos (u)^ + 4>) 


Consider the particular case <f> = 0, corresponding to the initial 
conditions y — ••1, dy/dt = 0 for / = 0. If ( 0, the situation 

may be quite complicated. Nonetheless, let us define the com¬ 
ponents X, = X, X 2 = dx/dt, and Xa = « for a vector x. TIhui (5) 
is equivalent to the vector eejuation 

;|f = /(x) (6) 

where /(x) = ^ —(w'‘ + xi co.s /)xi^ 


Introduce the initial vector 



and let x denote the solution of (0) satisfying x = c for f = 0. 
Now the right-hand member in (0) satisfies the Lipschitz condition 

|/(^) - Jiy) I 

= |x 2 - j/sl + |(w* -t- Xa cos /)xi - («* -f yj cos f)j/j| 

= IXi - Z/jI + |«*(x, - //,) + cos f(xaXi - y3yi)\ 

^ |x2 “■ J/ 2 I 4- w*|xi — Vil 4 I-*"! “ .V>l 4" I.Vil ix.i — //si 

< fH IX - ,v I 

provided 

4- |xj| < 7« I < m and |yi| < m (7) 
Let 

be a “neighboring” initial vector, and let y denote the solution of 
(6) satisfying y = c* ior t = 0. Of course, this is merely the 




66 NONLINEAR DIFFERENTIAL EQUATIONS 


vectorial version of the simple harmonic solution y{t). Using 
Eq. (23) of Chap. 2, we have 


\x - y\= lx - 7/1 + 


dx 

dt 


dt 


+ !«| < I c — c* I c”*' = le|c 


mt 


or, what is the same, 

1-r - yl 4- 


dx 

dt 


dt 


< - 1 ) 


( 8 ) 


According to (7), the Lipschitz constant m may be any number 
which is an upper bound to the number 1, to the values of 
w® + lej to be considered and to some quantity larger than tA| 
which allows for a possible increase in amplitude. The inequality 
(8) will then be valid so long as the bound on the amplitude is not 
exceeded. 


EXERCISES 

1. Explain why it is that the solution of (1) possesses a 
(fc + l)st continuous derivative with respect to t if the right-hand 
member in (1) possesses /rth-order continuous derivatives. 

2. Explain the significance of the quantity Xo® 4- (i/o/w)" 
introduced in Example 1. In what way should the results be 
modified if fc < 0? 

3. Show that (4) defines the “best possible" Lipschitz constant 
for (3). 

4. Discuss the significance of the inequalities in (7) and the 
reference to amplitude variations following (8). Show how (8) 
itself may be employed to establish a bound on the amplitude 
variations. 

5. Obtain an upper bound for the perturbations due to the 
nonlinear term in the satellite equation dhi/dl^ + « = fcu®. 

6. Let a denote a column vector with the components ai, 
02 , ... , aj. Reformulate the results of this section for the 
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system dxfdi = where /(S,j) is a Lipschitz function in each 

of the variables a,x. Extend the technique used in the proof of 
Theorem 3 of Chap. 2 so as to include the effects on a solution of 
variations in the “parameter vector” a. 

3. The Poincare Expansion Theorem 

Here we apply the “transfer” technique as mentioned above to 
analytical or partly analytical systems. We are primarily con¬ 
cerned with the effects of parameter variations in the system. 
For the proofs of the results, we need not distinguish between 
those parameters which arise naturally in the form of initial 
values and those which are of a more parasitic nature. However, 
for practical emphasis we do distinguish the two types of parame¬ 
ters in the statements of the results. 

It is clear from the equation 

= a + /„'/(*'“(«),») * (9) 

which (together with an initial choice defines the successive 
approximations to a solution x(0 of an initial-value problem, that 
if is analytic in t (for example, if x^®’ s c) and if J{x,t) is 
analytic in the pair {x,t), then x‘(0 is analytic in the pair (c,0 for 
each = 1, 2, . . . . If J{£,1) is merely continuous in t but 

analytic in X, then x<‘nO is analytic in e for each A: = 1,2. 

Thus, since the sequence x‘®\ x^‘\ . . . converges uniformly in 
the pair (e,l) to the solution of the initial-value problem, we 
have Theorem 1. 

Theorem 1 


Consider the vector system 
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and the initial vector 

c — 

If the right-hand member in (10) is analytic in the n + j + 1 
variables xj, x^, , x„, t, ai, or?, , a,-, then the solution 

x{t) of the initial-value problem x(0) = c is analytic in the 
n 4- i -f- 1 variables, Ci, c,, , c„, t, o-i, aj, . . . , a,-. If (10) 

is analytic in then-H i variables, xj, Xj, . . . ,x„, ai, a 2 , 
and continuous in t, then the solution of the initial-value problem 
is analytic in the n j variables Ci, Cs, . . . , Cn, ai, a^, . . . , aj 
and continuously differentiable in t. 

This theorem has proved to be of great importance in the study 
of classical dynamical systems generally, and in celestial mechanics 
in particular. It is the basis for almost all present-day perturba¬ 
tion theory. One should note that this is a local theorem and 
concerns an initial-value problem for which, in general, the 
independent variable t is restricted to b. finite interval. Thus, for 
example, it is not directly applicable to problems concerning 
perturbations of periodic solutions. There are, however, modi¬ 
fications of the expansion technique which apply to the latter. 



Example 3 

Consider the satellite equation 

d^tt 

— + U = kxi} (11) 

For A; = 0, (11) possesses the periodic solution 

u = .A cos / (12) 


where A is a constant. Let us characterize (12) as the solution 
of the initial-value problem 

u = A 



( 13 ) 
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for i = 0. If we apply the Poincar6 expansion theorem, we know 
that for sufficiently small |/;[, the solution of (11) satisfying (131 
may be expressed as a power series in k. Lot 

u = Wo + tiik + u-ik- ( 14 ) 

be the expansion. If we substitute (14) into (11) and equate 
coefficients of corresponding powers of k, we obtain a sequence of 
nested differential equations in uo, wi, 7/2 ... . The first three 
are 


d-iio , f. 

dt^ +"» 

(15) 

dhti 

dt^ + "■ =»»- 

(10) 

d'Ui , 

(17) 


Clearly Wo is given by (12), .«inee (14) reduces to u = uo for 
k = 0. Also, one secs that each of the w, with 1 > 1 must 
satisfy homogeneous initial conditions. lVing(12), (llj) becomes 


and hence 




4 * 

+ ~ cos 21 


Ui = A*(M — H cos 1 — cos 21) 



where the initial conditions Uj = du\/dt = 0 for 1 = 0 have 
been imposed. If (18), in turn, is used in (17), together with 
Uo = A cos 1, we obtain 

+ U 2 = cos 1 + 3^ COS 21 - >.y COS 3l) 


and so 

U 2 ~ A*( — }^ + ^^44 cos 1 + 5 ^ 2 ^ sin 1 + 3'y cos 2l 

+ Hs cos 31) 

We note that U 2 contains a resonance (secular) term, 1 sin 1. 
Because of the presence of this term and similar terms which 
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occur in the expansion (14), there is no suggestion at all that the 
solution might be periodic, or if it is, what the fundamental period 
might be. Yet for sufficiently small |A|, the solution is periodic. 
The secular terms arise because the frequencies of the expansion 
functions are incorrect. The picture is cleared if we search for the 
true fundamental frequency at the same time we search for the 
periodic solution. 

Following Poincar4,^ we replace the expansion (14) \vith one 
of the form 

u = yo{aft) + yi{ojt)k + yt{o)t)k^ + * ■ ■ (19) 

where each of j/o, Vi * * * is to be a periodic function of r = wi of 
period 2t. The quantity « is introduced as the true funda¬ 
mental frequency and will be an analytic function of k. To 
determine u, we introduce an expansion of the form 

w = 1 -f- o)ik -{- Uik^ “1“ . . . (20) 


where the first term is unity since the fundamental frequency 
reduces to unity for k - 0. The expansions (19) and (20) 
together represent a reorganization of the terms in (14) in such a 
way as to produce periodic coefficients for the power series in k, 
the coefficients themselves being power series in k. In terms 
of the new variable t = <at, (11) becomes 



and the counterparts of (15), (16), and (17), using the expansions 
(19) and (20), become 


dr* 


+ yo = 0 



d*y2 

dr* 


"I" yi — 2yoyi “ (wi* + 2«2) 

or* 



( 21 ) 

( 22 ) 

(23) 


* H. Poincard, "Les M^thodea nouvelles de la mdcaaique celeste,” vol. I, 
Gauthier-Villars, Paris, 1892. 
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Clearly, yo = -<4 cos t, and so (22) may be expressed 

+ »/i = -^ + 2wiX cos r 4- cos 2r (24) 

Unless 0)1 =s 0, every solution of (24) will contain a secular term. 
Thus we require that wi = 0 and eliminate the resonant term in 

(24) altogether. Then the appropriate solution becomes 

j/i = A*(>^ - 3'^ cos T - 3^ cos 2r) 

which is periodic in r with period 27r, as required. The third 
equation (23) becomes 

^ + ^2 = + 2 A^ 2 ) cos r 

- A>(M + Mcos2T + Mcos3r) (25) 

Every solution of (25) will contain a secular term unless oij i.s 
chosen so as to remove the first harmonic on the right. Hence, 
we require that U 2 = —5^4*712 and the appropriate solution of 

(25) becomes 

1/2 = A^(-^ + 2^44 cos 7 + 3-^ cos 2t + 3-:48 cos 3r) 

In a similar manner, the remaining terms of the two expansions 
(19) and (20) are determined by the initial conditions and the 
requirement of periodicity. The technique of “casting out” the 
resonant terms is referred to as Lindsled's procedure. 

It should be noted that the convergence of (19) will not be 
uniform in t for all I unless w is exact, although it may be uniform 
in r = for all t. As an expansion in functions of t, (19) is 
referred to as an asymptotic expansion. 

EXERCISES 

1. Explain why it is that the successive approximations (9) 
converge uniformly in {i,t) to the unique solution of the analytic 
system (10). Refer to ranges of the variables. 

2. By introducing a suitable artifice, use Theorem 1 to show 
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that the solution x(i) of (10) satisfying the initial condition 
i(<o) = c is analytic in the initial time le. 

3. Discuss the power-series expansions in /5 of the solutions of 

the DufRng equation d'x/dl^ + = 0. Obtain several 

terms of the expansion of the solution of an initial-value problem. 

4. Obtain several terms of a power-series expansion in /S of 
periodic solutions of the Duffing equation. 

5. Reformulate the Poincar4 expansion theorem (Theorem 1) 
for the system dx/dl ~ /(s,i,0 where a is a column vector with 
components ori, oj, . . . , Oj. 


4. Differentiability of Solutions 

We have seen that the solution of an initial-value problem for 
a continuous (analytic) system varies continuously (analytically) 
with the initial values and the system parameters. It is natural, 
and for certain purposes also important, to consider the question 
of differentiability of the solutions. The “transfer" technique 
is not applicable here since differentiability of approximates will 
not necc.ssarily be “passed on” to a uniform limit. It is neces¬ 
sary, therefore, to attack the problem directly. In view of the 
ease with which one deals with continuous and analytic systems 
in these matters, the proof of the following theorem is surprisingly 
difficult. 


Theorem 2 


If fa, . a,{x,l) possesses ^th-order continuous derivatives in 

the H + j -t- 1 variables on, o;, . . . , aj, t, Xi, Xj, . . . , 
then the solution of the initial-value problem 
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possesses A*th-order continuous derivatives in the n + j variables 
ai, ora, , ay, Cj, C 2 , , Cn. Furthermore, the derivative 

dx/dt possesses A-th-order continuous derivatives in the n + / + 1 
variables ori, ora, ... , ay, t, C\, Ci, , c„. 

Preliminary Remarks: In the proof of Theorem 2 one need 
not make a distinction between the two types of quantities a,, Ci. 
For by the artifice where one appropriately enlarges the system, 
one can accommodate all the quantities a.s initial values. .Vltcr- 
natively, if one considers, in lieu of x, the vector y = x — c, then 
(26) is equivalent to the initial-value problem 

.(27) 

j/(0) = 0 

where now all the quantities a., c. appear as system parameters 
and none as initial values. Since (27) is essentially of the same 
complexity as (26) (being of the same dimension and not of a 
higher dimension), there would apparently be some tactical 
advantage to employing the second of these two artifices. In 
point of fact, however, we shall give a proof of Theorem 2 only 
for the scalar case n = 1. The essential arguments for the 
general case are illustrated therein.* 

In the proof we employ still another version of the Gronwall 
lemma. 

Lemma 1 

If ‘I>(0, ^(0, and p(0 are each nonnegative continuous functions 
for i > 0 and c is a positive constant such that ^{t) < c + 

^ {^(s) 4>(a) + p(«)] da for t > 0, then 

*(i) < c exp [^(s) -I- p(s)/c] dsl 

for ( > 0. 

‘ For a proof io the general case, sec S. Lefschetz, “Differential Equations: 
Geometric Theory,” pp. 40-43, Interscience Publishers. Inc., New York 
1967. 
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Proof op Theorem 2 for n = 1: We consider the scalar 
equation 




where /(or,x,0 is continuously differentiable in a, x, and t for a in 
some interval I, for x in some neighborhood of an initial value c, 
and 0 < i < b, b > 0. Then for each a in /, (28) possesses a 
unique solution x(o,0 for 0 < i < 6, which satisfies x(a,0) = c. 
We wish to show that x(a,t) is continuously differentiable with 
respect to a and that dx (a,t)/dC is continuously differentiable 
with respect to both a and /. Consider first the differentiability 
of x(a,t). Let a in / be fixed, and h ^ 0 he such that a + ^ is 
in I. Then w'e have for 0 < i < 6, 

x(a -h h, t) “ c + ^ /(a + h, x(a + k, s), s) ds 
and x(a,0 = c + a:(a,s), s) ds 

The pertinent difference quotient may be expressed in the form 

X(a -h h, 0 — X(a,t) 

h 

= + K + K s), s) - /(g + ft, x(or,s), s) ^ 

jo h 

+ [‘ /(« H- h, x{a,s), s) ~ f(a, x(a,s), s) . 

jo h ^ ^ 

We regress for the moment and consider the linear differential 
equation 

^ = /j(a, x{ct,t), 0 2/ + x{a,t), t) (30) 

Here we use the notation df/dx - and df/da = fi, where 
/ = is the right-hand member in (28). Into these partial 

derivatives has been substituted the solution x(a,i) of (28). The 
hypotheses concerning f{a,x,t) imply that (30), in addition to 
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being linear in y, is continuous in i for 0 < / < 6 and therefore 
possesses a (unique) solution satisfying y = 0 for / = 0. In 
fact, this particular solution satisfies the integral equation 

y(0 = Jq [ftia, x(a,s), s) yis) +/i(a, J-(a,s), s)] ds (31) 

and we shall show that y{t) is the limit as A 0 of the difference 
quotient in (29). To see this, we subtract (31) from (29) and 
express the result in the form 


x{a + h, /) - xia,t) 


- ^(0 


- 1 : 


+ h, x{a + k, s), 8) - /(a + h, x(a,s), s) 


- fi{oc + h, xia,s), s) y{s) ds 




i'P 


+ h, x{a,8), s) - /( 


O, jr(o!,S), S) f ! ! ^ ^1 j 

-/i(a, x(a,s), 5) ds 

+ ^ [Ma + h, x{a,s), S) - fiia, x(at,s), s)) y{s) ds (32) 


Now using the mean-value theorem, we may write 


f{a + h, x{a -H h, «), s) - f{a + h, x(a,s), s) 

= [/i(a -f h , x{q,s), s) + <i(s,A)][x(a + k, s) — x(a,s)] (33) 

and 


/(a -f h, x{a,s), «) - /(or, x(a,«), s) = (/i(a, x(a,5), s) + ii{s,h)\h 

(34) 

where <i(s,A) and <j(s,h) are continuous in s and tend to zero 
uniformly for 0 < s < 6, as h—*0. Further, since ft is con¬ 
tinuous, we have 


fiia -{- h, x(o,s), fi) - fi{a, x(o,s), $) = ti(8,h) (35) 

where (z(8,h) is also continuous in « and tends to zero uniformly 
for 0 < « < 6, as /i-> 0. Introducing (33), (34), and (35) into 
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(32), the latter may be expressed in the form 
x{a + A, 0 - x(tt.O _ h,8) ~ x(a,8) 


n 


h 


- yis) 


1 / 2 ( 0 ! + k, x(a,s), fi) + €i(»,h)] ds 
+ f Ms,h) + [«i(«,/i) + €i{s,k 


1 


Now with 




^ I x(a k, t) — x(a,t) __ 


y(t) 


and 


}p(s,h) — |/ 2 (a + h, x{a,s), s) + €i(s,A)| 
p(s,h) = !€ 2 ( 8 ,A) + Ui(«,A) + < 3 ( 5 ,^)) j/(s)| 


Eq. (36) leads to the inequality 


Ht,h) < j‘ (4>(s,A) ^(s,A) + p( 5,A)) * 
Thus, by Lemma 1, 

^(t,h) < c exp 1^* [^^(s,h) + j ds 
for every positive number c. In particular if we let 


then (37) results in 


c = c(h) = max |p(8,/i)l 

o$« <b 


(37) 


< c(h) exp 11^* 1^(5,A) + 1] rfs} (38) 

Clearly c{li) -» 0 as /j —* 0, and since at the same time, ip{8,h) 

1 / 2 ( 0 ', x(o',s), s)|, (38) implies that ^(t,h) 0, in fact, uniformly 

for 0 < i < 6. Thus 


lim ^ 0 " ^ 

A-*0 h 

uniformly for 0 < ( < fc. This not only shows that is 

continuously diflferentiable with respect to a but that the deriva¬ 
tive dx (c.,t)/da is the unique solution y(l) of the linear equation 
(30) which vanishes for I = 0. Equation (30) is known as the 
equation of first variation of (28). 
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To see that dx {afy/di is continuously differentiable with 
respect to both a and one need merely observe that/(o, T(a,0, 0 
is continuously differentiable with respect to both a and i. For 
by (28), the latter is already dx {a,i)/dl. Finally, by induction, 
one extends the result to an arbitrary (finite) number of variables 
a and to higher-order derivatives. 


EXERCISES 


1. By introducing a suitable artifice, use Theorem 2 to show 
that the solution x{l) of (28) satisfying the initial condition 
x(to) = c is continuously differentiable with respect to U. 

2. Prove Lemma 1. 

3. Show that the derivative with respect to ai(l < k < j) of 

the solution i(/) of the initial-value problem (26) satisfies the 
linear vector differential equation dy/dt = fiix{t), t) y + (x(/), 

t), where the Jacobian matrix 





• 

dxi 

dxi 

dXn 

?b 


df-> 

* • ^ 

dxi 

dxz 

dXn 


dfn 


dxi 

dXi 

. 


and the partial derivative 






dak 



are each evaluated for £ = xii). What is the appropriate initial 
condition for 
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4. What linear vector differential equation is satisfied by the 
derivative with respect to t of the solution x{i) of (26) ? Illustrate 
for the scalar case (28). 

5. What linear vector differential equation is satisfied by the 
derivative with respect to a component of c of the solution y(t) 
of (27)? Illustrate for the scalar case (28). 

6 . What linear differential equation is satisfied by the deriva¬ 
tive with respect to A: of a solution u of the satellite equation 
d^u/dt^ + u — ku^? Obtain several terms of a power-series 
expansion of a periodic solution of the derived equation and 
compare with the k derivative of the expansion (19). 

7. Using Exercise 5, show that the matrix 



dXi 

dxi 

AAA 

dXt 


dci 

dct 

dCn 

_ dx 

dXi 

dx2 

dxz 

II 

^1 

II 

dci 

• • « 

dCi 

dc„ 


dXn 

dXn 

dXn 


dci 

dCi 

dCn 


where x = x{t) is the solution of (26) satisfying the initial condi¬ 
tion x(0) = c, satisfies the linear matrix equation 

dX 

— = J±{x{t), t) X 

where ft is the Jacobian matrix of Exercise 3. For t fixed, the 
determinant |X| is the Jacobian of the transformation which 
maps each initial vector c onto the corresponding point x(0 along 
that trajectory which, in turn, has c as initial value for i = 0. 
Illustrate for the scalar case (28) and show that, as a function 
of t, the Jacobian J satisfies the linear differential equation 
dJ/dt = f^(a, x{i)y t)J, where = df/dx and / = /(o,a:,<) is the 
right-hand member of (28). Express </ as a definite integral in t. 
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1. Bases and the Principal Matrix Solution 

Suppose that an n-by-n-matrix function A{t) is continuous for 
0 < / < 6, 6 > 0. Then for any n vector c, there exists a unique 
solution of the linear initiaUvalue problem 

t - (') 

m = c ( 2 ) 

for 0 < / < 6. This follows from the general existence-unique¬ 
ness theorems of Chap. 2. As one varies the initial vector c in 
N-spaee, one obtains ail solutions {for 0 < i < 6) of the difTeren- 
tiul equation (1). In fact, the family of solutions of (1) form 
an n-dimcnsional vector space which is isomorphic to the n-dimen- 
sional vector space of initial vectors. Because there are bases 
which generate all c in n-space, there are also bases which 
generate all solutions of (1). We shall introduce a particularly 
important base which is to be used throughout. 

If • • • . is any base of the solutions of (1), then 

each solution x of (1) is a linear (unique) combination of these 
basic vectors. That is, there exist suitable (unique) scalar 
constants aj, aj, . . . , or„ such that 

i(0 = + a,y(«(0 + • ■ • + a„y<">(0 

79 


( 3 ) 
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holds identically in <(0 < i < 6). If . . . , are the 

initial values (vectors) of the basic vectors, • • • > 

respectively, then the initial-value (vector) of x is 

For the study of the initial-value problem (1), (2), we shall find it 
convenient to use the very special base determined by the initial 
vectors 



1 

0 

0 

0 


rO = 




The corresponding basic solutions . . . , are not 

always the most natural nor the simplest to obtain, but they are 
particularly convenient for the study of the initial-value problem. 
For example, by (5), it is clear that the scalars ai, as, . . . , a, 
then become the components of c, i.e.; the right-hand side of (4) 
becomes the vector 

Oj 

a„ 






Thus, the general solution of (1) is 


where 



(6) 

(7) 


is the initial value (vector) of x. It is convenient to introduce a 
single symbol for the base y'*’, . . . , y^"'and this we do in a 
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natural way with the n-by-n matrix 


Y = 


^C")) = 


// •/" !hJ- ' 


• • Ih 

■ • y-. 




(n) 


( 8 ) 


II <*' II 

.7 " ,7 '• 


!/' 


fnl 


which consists of a roM’of the column vectors . . . , 

Here, and throughout the remaining chapters, y‘-’.yf"* 

will always denote the n particular solutions of (I) which assume 
the initial values (5) for t = 0. Similarly, Y will always denote 
the matrix array (8) of these particular solutions. Ecpiations 
(0) and (7) are compactly reformulated in the single equation 


X = Y 


c 


(9) 


Then the general solution of (1) is expressed as the product of the 
fixed 7i-by-n-matrix function Y and an arbitrary (constant) 
column vector c. In this way, the initial-value vector c of a solu¬ 
tion X is exhibited in a direct and compact fashion. For any 
such pair, we have, from (9), 

(It dt ^ 

More generally, if we consider n arbitrary solutions (not 
necessarily distinct nor linearly independent) i‘**, . . . , 
of (1) corresponding to n arbitrary initial vectors c‘*’, . . . , 

c'-^\ then we have, from (9), the n vector equations 


dt 


dt 


J= 1,2, . 


n 


( 10 ) 


The n vector equations (n* scalar equations) represented by (10) 
are equivalent to the single n-by-n-matrix equation 


dt 


dY 

dt 


( 11 ) 
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where X «= (x^*^ • • • 

xM) 

(12) 

and C = (c**^ • * • 

c(«)) 

(13) 

Thus the matrix analogue of (9) becomes 



X = YC 


(14) 


where C is called the initial c(mdiiion matrix. Equation (14) is 
merely a compact expression for n vector solutions of (1) in terms 
of the corresponding n initial vectors. On the other hand, since 
for each y = 1, 2, . . . , n, is a solution of (1), we have 

dx^f> 

^ = A{t)x^i^ (15) 


and the n differential equations (15) for j = 1, 2, . . . , n may 
be written compactly as the single matrix differential equation 


dX 

dt 


= .4(0 X 



Equation (16) is called the associated matrix equation. Every 
matrix solution of (10) corresponds to n vector solutions of (1). 
Conversely, every set of n vector solutions of (1) corresponds to 
one matrix solution of (16). Equation (16) is equivalent to 
simultaneous scalar differential equations in which there is con¬ 
siderable algebraic redundancy. In fact, if the equivalent n* 
scalar equations are written in the usual form of a column vector, 
(rather than the square array implied by (16)), then the n*-by-n*- 
systein matrix may be expressed in the form 



A(t) 

(0) 

(0) 

• • • (0) 

(0) 

« • • ^ 

^(0 

4 « A 

(0) 

• - . (0) 

(0) 

^ ^ 9 

(0) 

^ ^ A % 

(0) A (t) 


with the 7i-by-n matrix 
diagonal as a submatrix, 
equation 


i4(0 appearing along the principal 
The corresponding vector differential 


dt 


E{t)z 


(17) 
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is a linear vector system whose coefficient matrix £“(0 is con¬ 
tinuous. The general existence-uniqueness theorems apply to 
(17) and thus also to the equivalent matrix system (16). 

The general solution of (16) is given by (14), where 1' is the 
particular solution of (16) satisfying the initial condition 



I (the identity matrix) 


y’(<) is called the -principal matrix solution. 


Example 1 

Consider the equation d^x/dl^ + x = 0, or rather, the equiva¬ 
lent system 


dx\ 



dxi _ 

It *■ 




The vector version of (18) is 


where 


dx .. 
* = 


■ (-:;) 


We have the elementary solutions 


r,(i) 


y 


yit) 


( cos t \ 
— sin (/ 

( sin t\ 
cos t/ 



and 

If we let 


v = = ( cost sin A 

y I V-sint cost/ 
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then Y is the principal matrix solution. Indeed, F(0) is the 
identity matrix. The general solution of the matrix equation 
dX/dt = AX is 



( cos t 
— sin i 


sinA/cti Ci 2 \ 
cos tj \C2i C*2/ 


for arbitrary Cji, Ci 2 > C 21 , and C 22 and the general solution of (19) is 


X — Yc == 


( cos t sin A /ci\ _ / cos ^ \ , /sin A 

— sin i cos t)\ct/ sini/ ^*\cos// 




for arbitrary ci and C 2 . 


Example 2 

Consider the equation 


di^ 



and its vector equivalent 


where 





As is well known, and are solutions of (20) 

and form a base for all solutions. Hence 

*<.. = and 

form a base for all solutions of (21). On the other hand, 

= (-0 ( 22 ) 

80 that this base does not correspond to the principal matrix 
solution. Considering the initial \ectors (22), it is clear that 
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yd) = (xO) -I- xt »]/2 and = (x“' - x<-^]/2\ are the desired 
basic vectors. Interestingly enough, these correspond to the 
familiar hyperbolic solutions cosh M and (1/X) sinh \t of (20). 
The principal matrix solution is 


/eosh \t (1/X) sinh XA 
\sinh \l cosh X^ / 


and the general solution of ( 21 ) is 


/cosh \t 
\sinh \t 


(1/X) sinh XA /cA 
cosh \t ) \c >} 


= c,y”> + 


for arbitrary ci and c>. 


Example 3 

Consider the rdh-order linear equation 

7/r + + • • ■ + h,r = 0 (23) 

where 6 i, 62 , , b„ are continuous functions of 1. Let 

xd>, . . . , xf'‘> be an arbitrary family of n solutions of ( 23 ). 
Corre.sponding to these n scalar solutions there are « vector solu¬ 
tions , a-f"’ of 


where x = 


and 




1 0 0 
0 1 0 



• 44 


9 4^ 


0 
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The first component of is i = 1, 2, , . . , n. Let 
X = • • • x<"^) be the corresponding matrix solution of 

^ = AX (25) 

at 

and «) = jXj = determinant of X. Evidently 


jd) 

j.(2) . . . 

^{n) 

dx<»> 



dt 

dt 

dt 


^(n-l)3.(2) 

A * « 

rf(n-l>a;<n> 



dl’'-^ 


This determinant is commonly referred to as the Wronskian of 
thensolutionsx<‘\x^*\ . . . ,x^*\ In particular, it is well known 
that the n solutions are linearly independent if and only if the 
Wronskian is different from zero. Thus they are independent if 
the corresponding matrix solution X (0 is nonsingular. Our next 
theorem will establish the converse. 

♦ ♦♦♦♦♦♦ 

Consider the matrix equation 

^ = A(t) X (26) 

at 

where A — (a,-,), and let = 1X| be the determinant of a matrix 
solution of (26). We wish to discuss the nature of the scalar 
function w — = l.X'(i)l. The determinant jX] consists of 

sums of products with each product containing n factors (consist¬ 
ing of elements of the matrix X, exactly one factor from each row 
and each column) multiplied by +1 or —1. Thus, from the 
product rule for differentiation, it follows that the derivative 
dw/dt consists of the sum of n similar determinants, within each 
of which exactly one row of elements has been replaced by 
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corresponding derivatives. Thus 


dw 

Hi 


rfxii 

dxu 

dxi„ 



Xl2 

• • • Xu 

dl 

dt 


dt , 


dx^i 

dx22 

f/xj 

• • 

X2\ 

X 22 

• • • X2n 

+ 

dt 

dt 

dt 


# ♦ # 


# # 

X31 

* % ^ 

X 32 

• • • Xj, 

XbI 

X„2 

• • • 

nn 


Xr.1 

Xb2 

• • • X„n 



1 

1 

Xii 

» # ♦ ♦ 

X|2 

♦ ♦ « # 

4 • 

9 4 • 

Xu 


+ 

• • • + 

• # 

X(„ 

• ^ 

X(n-1)2 • • 

X(n.j)n 




dx„i 

dx„2 






dt 

dt 


dt 


(27) 


Since the columns of X are solutions of the vector equation 

ft = '‘w ^ 

we have, for the derivatives in the first determinant of (27) 

dx\i 


(28) 


dl 

dxn 

dt 


~ QiiXii + dnXii + 


*1” fllnXnl 


— + a 12 X 22 + ■ ' • + ai„Xn2 


(29) 


dXin , 

-fljlXlB -f- ai2X2n + • • • + fllnX,, 


If the derivatives appearing in the first determinant in (27) are 
replaced by their corresponding expressions in (29), we obtain 


n 

n 

n 

> ai.Xii 

y aiiX ,2 ' • • 

S 


1-1 

l-t 

X21 

X22 • • ' 

X 2 n 

XbI 

x »2 • • • 

Xnn 



Now if we multiply the second row of (30) by a ,2 and subtract 
from the first row, the value of the determinant is left unchanged. 
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Similarly, if we multiply the ith row of (30) by au (2 < i < n) 
and subtract from the first, the value of the determinant is left 
unchanged. It follows, therefore, that the determinant 



OiiXij • • • 

aiiXin 

3^21 

« • • « 

X22 • • • 

X 2 n 

% « « • 

Xnl 

Xni ■ ' • 

•l^nvi 



has the same value as (30). But (31) has the same value as 
aii|X|. Similar considerations of the A:th determinant in (27) 
show that the value of the fcth determinant is given by a*fclX|. 
Thus (27) may be expressed in the form 


dw 

It 


= Qnw + a 22 W + • • - + a„„w = 




where the scalar quantity 


VI 

y atk is the trace of the matrix 

kml 



We have, therefore, the important Theorem 1. 


Theorem 1 

If X is a solution of the matrix equation 

^ = A(0 X (33) 

for 0 < t < 6, 6 > 0, then 

1A'(01 = |-V(0)| exp [ trace /l(s) rfs] (34) 

for 0 < i < 6. 

Proof: The general solution of the scalar equation (32) has the 
form w = U)(0) exp trace ^(s) ds] which is (34). 

The importance of (34) lies in the fact that if 1X(0)| 9 ^ 0, i.e., 
the initial condition matrix C = X{0) is nonsingular, then the 
matrix solution X(0 of (33) remains nonsingular. In particular, 
the principal matrix solution Y{t) is always nonsingular since 
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Y{0) = I. In vector language, Theorem 1 states that a set of n 
solutions of ( 1 ) remain linearly independent if they are initially 
linearly independent and that they remain linearly dependent 
if they are initially linearly dependent. 

For the nth-order equation in Example 3, the trace of A is 
merely the negative of the coefficient 6 „. Thus, the Wronskian 

satisfies uj(0 = |X(/)| = |-Y(0)1 exp — 6 ^( 5 ) dsj, a well-known 

result for nth-order linear difTcrcntial equations. 

EXERCISES 

1. Show that the family of solutions of ( 1 ) form a vector space. 
Show that this vector space of solutions is isomorphic to the 
vector space of initial values. 

2. Explain, in detail, the equivalence of the vector system (17) 
and the matrix system (10). What solution of (17) corresponds 
to the principal matrix solution of ( 10 )? 

3. State and prove (without reference to vector systems) an 
existence-uniqueness theorem for the matrix system (16). 

4. Obtain the principal matrix solution for the associated 
matrix equation of the general linear second-order equation 
d^x/dt^k dx/dt A-= 0 with constant coefficients. Con¬ 
sider the various cases discussed in Chap. 1. 

5. Let each of xi and . 1-2 be a solution of the above linear second- 
order equation. Multiply d^Xi/dt^ + k dxi/dt + (ji-xi = 0 by X2 
and d^Xz/dl^ + kdx^/dt + «*X2 = 0 by aq; subtract and show 
that the quantity P = xz'd{xi/x 2 )/dt satisfies the first-order 
equation dP/dt -j- kP = 0. Thus show that if ii(0) ^ 0, then 

xi = ciXi + C 2 X 2 Jq ds for suitable constants C| and cj. 

Discuss the independence of the solutions xi and xt. 

6 . Using the notation of Exercise 5, show that the quantity 
Q = xi dxi/dt — Xi dxi/dt satisfies the first-order linear equation 
dQ/dt kQ = 0. Show that this leads to (34) for this special 
case. 
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7. Generalize the technique in Exercise 6, and derive (34) for 
the general nth-order linear equation (23). 

8. Con.sider the second-order equation 

d^x , j dz . ^ ^ ... 

di- ^ dt ^ 


where each of k and w- is a constant. Illustrate Theorem 1 for 
this special case. For t fixed, define a transformation of the 
phase-plane vectors onto themselves such that 



maps to 




where x = ci and dx/dt = ci for t = 0. The Jacobian of the 
transformation is given by 


dxi dxi 



dci 

dxt 


dCi dc2 


and depicts the changes in area under the transformation. 
Using (i), obtain the relations 

^ I ^ !L( ^ ^ 

dt\dci) dci dt\dc 2 ) dc 2 

z. ^-^2 d/axA axi , dxj 

dt\ac,) “ ac, 

and then show that J, as a function of t, satisfies the differential 
equation dJ^dt = —kj. Explain why this proves Theorem 1 
for the special case (i). 

9. Using the technique outlined in Exercise 8, show that the 
corresponding Jacobian J for the nonlinear equation 


d'X 

W 


+/(x) ^ = 0 


is given hy J = exp 


- /oV(3:(s)) ds]. 
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2 . The Linear Inhomogeneous Equation 
(The Adjoint Equation) 

Consider the initial-value problem 

^ = ^(/) x +/(0 


x(0) = c 


(35) 

(36) 


where and/(() are continuous for 0 < i < 6, b > 0. There 
exists a unique solution of (35), (36) for 0 < f < 6. In fact, we 
shall obtain an explicit expression for this unique solution. 

Let Z(t) be the matrix solution, satisfying Z(0) = /, of the 
equation 

dZ 


dt 


= -Z A{t) 


(37) 


where A{t) is as in (35) and I is the identity matrix. The 
reduced associated matrix equation, corre.sponding to (35), is 


dX 

dt 


= A{t) X 


(38) 


and Eq. (37) is called the adjoint of (38). There is a simple 
algebraic relationship between any solution of (37) and any solu¬ 
tion of (38). For, if we multiply (37) on the right by X and (38) 

on the left by Z and add, then the sum may be expressed in the 
form 

ii =« 

Hence, the product ZX is always a constant, i.e.. 


ZX = C(constant matrix) 


(39) 


In the present case, Z is nonsingular and we may solve (39) to 
obtain X, 


X = Z~^C 


( 40 ) 
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For C arbitrary, this is the general solution of (38). On the other 
hand, = / for ( = 0 and so, necessarily, is the principal 
matrix solution Y{t) of (38). Then, of course, is 

principal matrix solution of (37). We have, therefore, in addi¬ 
tion to 

the reciprocal (adjoint) equation 

(41) 

at 

for any principal matrix solution. 

If Eq. (35) is multiplied on the left by y'”'(0 Eq. (41) is 
multiplied on the right by and if the two results are added, 
then the sum may be cxpre.sscd in the form 

= K-'(()/(() 

This in turn implies that 

K-'(() m = C + y-‘(s) /(«) ds (42) 

The constant of integration in (42) is the initial vector c, since 
Y-KO) = /. Thus 

i(() = K(() I + no r-‘(s) /(S) ds (43) 

is the solution of the initial-value problem (35), (36). The first 
term on the right is the general solution of the corresponding 
reduced equation, i.e., the corresponding homogeneous equation, 
and the second represents the response to the forcing function 
}{t) of the system initially at rest. 


Example 4 

Using Example 1, we obtain the general solution of the equa¬ 
tion d}x/dl^ -f X = f{l) in the form 
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( COS t sin A /f A 
— sin / cos tj \c:/ 


/ cos I sin A n / cos s sin sV' / 0 \ 
\—sin / cos// JO \— sins cos s/ \fis)J 


where 


X = I 


It may be verified directly that 


( cos s sin s\“' _ /c( 
— sin 5 cos s/ \si 


cos s — sin 


sin s cos 


in s\ 

3S ) 


Thus 


( cos s sin / 0 N _ sin s fis)\ 
— sins cos s/ \/(s)/ \ cos s f{s)J 


and the expiession for x l)ecomes 

X = Cl cos t + Cz sin I — cos / sin s/{s) ds 

+ sin t COS s/(s) ds 

= Cl cos ( + Cs sin i (sin / cos s — sin s cos () f(s) ds 

= Cl cos f + C 2 sin i sin (/ — s) /(s) ds 

Example 5 

Using Example 2, we obtain the general solution of the equa- 
ton d'^xfdl- — X'x = f{t) in the form 


X = 


cosh X/ * sinh xA / * 
X sinh Xt cosh X^ / Vz, 


I / cosh X^ - sinh Xt 

■^l . ^ 

\X sinh \t cosh Xt 


i: 


— sinh Xs 


/(«) ds 


cosh Xs f{s) ds 
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where we have used 


( cosh \t 
X sinh Xi 



cosh \t 


( cosh M 
— X sinh \t 


— - sinh \t 

A 

cosh \t 


Thus X is given by 

z(0 = Cl cosh X/ + C 2 — cosh \t [ /(s) ds 

X _/o X 

f cosh Xs/(s) ds 

A Jo 


— Cl cosh Xi + C 2 


sinh \t 


+ 


1 fi 

-1 (sinh \t cosh Xs — sinh Xs cosh \t) f(s) ds 


Cl cosh \t 4- C 2 ' + T X(( — s) f{s) ds 

A \ Jo 


♦ ♦♦♦♦♦♦ 


If A is a cunstanl matrix, then the principal matrix solution 
Y{t) of (o8) satisfies 

a. y{t + s) = }'{() }'(s), for all s and t with 0 < s < b and 
0 < / < 6. 

In fact, for 5 fixed, A (f) = }'(/ + s)isasohitionof (38)satisfying 
A (0) =>{«) = lienee, from (14), }'(f + s) may be expressed 
in the form I (f + s) = l'(/) C = )'(() )'(s), which is property a 
above. For constant .1, therefore, l'(0 shares a familiar prop¬ 
erty with the scalar exponential €“' (namely, = c^'c***] which 

is the solution of (/.r/f/f = ax satisfying j(0) = 1. We denote by 
the principal matrix solution r(0 whenever .4 is a constant 
matrix, and the analogy with the scalar case is then complete. 
It is possible to define the exponential of a matrix as the sum of an 
infinite serie.s of matrices, so tluit the familiar power-series 
expansion of c"' about I ~ 0 carries over formally to c-^‘. It 
should be observed that property a implies that the matrices 
Y(t) and Y{s) commute. 
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Another property of interest for constant A is the following. 
Clearly, the matrix = V(t) A is a solution of (38) satisfy¬ 

ing X(*>(0) = A. On the other hand, if we multiply (38) on the 
left by A, we have 


dAX 

dt 


= A(AX) 


and hence, in particular, the matrix = A r(0 appears as 

a solution of (38) satisfying the initial condition ^^^‘(O) = A. 
Thus, since the solution of this initial-value problem is unique, 
we have 

h. A Y{t) = Y{t) A 

This is to say, Y{t) commutes with A. Property b would be 
obvious from a power-series representation of }’(0 = e^’. 
Clearly, the matrix X'«(0 = Y(~t) satisfies the equation 
dX^^^/dt = - AA"'^' and by property 6, therefore, also the adjoint 

equation = -A'^'A. Since At®'(0) = J'(0) = /, 

A'»(0 = K(-0 

is the principal matrix solution of the adjoint equation and, in 
fact, the inverse of 7(0 [see (41)]. Thus, we have 
c. K-HO = 7(-0 

This also follows from property a since for s = -t, a yields 
>^(0 i '(“0 = T ( 0 ) = /. 

Because of properties a and c, the general solution (43) may bo 
written in the form 

x(0 = Y{t) c Y(t - s) J{s) ds (44) 

This is the general solution of an inhomogeneous linear system 
with constant coefficients. It involves a convolution integral 
which convolutes the principal matrix solution of the correspond¬ 
ing homogeneous system with the forcing function of the inho¬ 
mogeneous system. The final expressions for the solutions in 
Examples 4 and 5 were each of the form (44). 
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EXERCISES 


1. Show that each row vector I' of the matrix Z in (37) satisfies 
the vector equation 


dz^/dl = -r A 



where z' A is the usual row Ijy column product of a row vector and 
a square matrix. Equation (i) is called the adjoint of the vector 
equation (1). 

2. Determine the adjoint equations of each of (19), (21), and 
(24). Give the scalar version of each of these adjoint systems. 

3. Let .l'(0 denote the transpose of the matrix /1(0- Show 
that the transpose of the matrix .‘solution Z of (37) satisfies the 
equation dZ'/dt = — .r(f) Z'. Hence, using Exercise 1, show 
that if a row vector z' of the matrix Z is written as a column 
vector 2 , then dz/df = —A'{t)z. If the matrix .4(0 is skew sym¬ 
metric, i.e., .4(0 = — .4'(f), then the .system (38) is said to he 
self-adjoint. Wliat special geometric characteristic's of solutions 
of (1) are expressed by (39) for self-adjoint systems? What 
special properties are po.'^sessed by the principal matrix solution 
F(0 of a self-adjoint .system? 

4. Verify that (43) is a solution of (35). 

5. Derive the solution.'? in Examples 4 and 5 using the method 
of variation of parameters. 

G. Using property a and Examples 1 and 2, derive some 
familiar trigonometric and hyperbolic identities. 

7. Let ,4 be a constant matrix. Show that the matrix series 


^ ^U7V7,-! 


converges absolutely and uniformly on each interval 


^ ^ ^ l>' /) > 0. In fact. .‘?how that the series satisfies the 

difTerential equation dX/dt = AX and then explain why it is 
necessarily the principal matrix solution. Show directly that 
properties a, b, and c hold for the above series. 

8. Let each of .4 and B he a constant «-by-n matrix. Give 
two proofs that = c-'v®' for all /. if and only if .47? = BA. 
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9, Consider the absolutely and uniformly (for 0 < / < 6, 
6 > 0) convergent series 


exp 



.•l(s) ds = 


htu: 





Under what circumstances is this the principal matrix solution 
of (38)? 

10. Interpret the convolution integral in (44) as the super¬ 
position of solutions of the homogeneous system 

^ = A(0 i (ii) 


For each fixed s > 0. determine the .solution x of (ii) which 
satisfies the initial condition x = J{s) for t = s and then explain 
how to construct (44) by superposition. 

11. Show that (44) may he written in the alternate form 

*(() = Y(t) c + K(s) /« - s) ,h 

Interpret this form of the convolution integral as the superposi¬ 
tion of solutions of (ii). 

12. Which of the properties a, b, and c does the principal 
matrix solution share with all nonsingular matrix solutions of 
(38)? A nonsingular matrix solution of (3o) is referred to as a 
fundamental matrix solution. 

13. Let X{t) be a fundamental matrix solution of (38). Show 
that 

m = X(l) c + A'(() X-'M /(s) ds 

is a solution of (35) for any constant vector c. ICxplain why this 
is a general solution of (38). 
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3 . Linear Homogeneous Equations with Constant 
Coefficients 


We now study, in detail, the special equation 




where /I is a constant (real) matrix. Much of what we shall do 
here reflects, for n-space, concepts which were introduced in 
Chap. 1 for two-space. In fact, we begin by considering a 
linear transformation 

« = Bx (46) 

where B is a nonsingular (constant, not necessarily real) matrix. 
Equation (46) may be inverted to yield 

X = (47) 

We interpret (46) merely as a change of coordinates in a complex 
n-space and seek the corresponding differential equation in u. 
For this purpose, the inverse mapping (47) is easier to treat 
than the direct mapping (46). For from (47), we have 

dx du 

^ Tt 

and from (45) dx/dt = Hence 



{BAB-^)u = Eu 



\\herc E — BAB * is an equivalent coefficient matrix in the u 
coordinates. In matrix algebra, two matrices A and E are said 
to be similar if there exists a nonsingular matrix B such that 

E = BAB-^ (49) 

Thus, the transformation of coordinates (46) changes the form 
of the differential equation (45) only to the extent of replacing 
the coefficient matrix A by a similar matrix. 
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Given the system (45), what we seek is a matrix E, similar to 
A, such that (48) is easy to solve. The simplest situation occurs 
when we can find a diagonal matrix E, i.e., a matrix with nonzero 
elements along the diagonal only. This corresponds to a com¬ 
plete uncoupling of the system. When this happens the general 
solution of (48) may be written down immediately. The entire 
process reduces to considerations of the eigenvalues of the matrix 
A. By definition, X 0 is an eigenvalue of A if X satisfies the 
nth degree algebraic equation 

\A - X/| = 0 (50) 

This is, in fact, the characteristic equation of the system (45) and 
we shall refer to its nonzero solutions, not as eigen\-alues, but as 
characteristic values or numbers. The zero solutions of (50) are 
also included as characteristic numbers, and so counting multi¬ 
plicity, there are exactly n complex characteristic numbers. 
Using (49), it is easily shown that every matrix E which is similar 
to A possesses exactly the same characteristic numbers. They 
arc numbers characteristic of the differential system and not 
of the particular coordinate system used in expressing the 
dynamics of that system. There accompanies the eigenvalue 
problem an eigenvector problem. In fact, (50) depicts those 
values of X such that nontrivial solutions u of the algebraic 
equation 

Au = Xu (51) 

exist. This is not the analogue of the eigenvector problem 
discussed in Chap. 1, however. The latter concerns the eigen¬ 
vectors of the transformation matrix B of the space variables. 
An eigenvector of B depicts an invariant direction in the complex 
n-space, under (46), and although an eigenvector of A, i.e., a 
solution of (51), similarly would depict an invariant direction 
under a transformation u = Ax, the latter geometric transforma¬ 
tion we here have simply no use for (see Exercise 5, however). 
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Thus we study the eigenvalues of A merely to discover the pos¬ 
sible forms into which the differential equation may be recast. 

If .E is the diagonal matrix 



0 0 
Xj 0 






then clearly the diagonal elements Xi, Xs, . . . , X„ are the char¬ 
acteristic numbers of E. It is not difficult to show that an 
n-by-n matrix A with n distinct characteristic numbers Xi, 
Xj, . . . , X„ is always similar to a diagonal matrix. From this, 
we have the important Theorem 2. 


Theorem 2 

If the n characteristic numbers of the system (45) are distinct, 
then there exists a nonsingular matrix B such that 


BAB-^ = 



0 0 

X. 0 




The principal matrix solution of (48) is then 



and the columns of B~^U form a base of solutions of (45). In 
particular, each component of each solution of (45) is a linear 
combination of the exponentials e^**, ...» 

Some of the X,- in Theorem 2 may be complex. In such a case, 
real solutions are obtained in the usual fashion by combining 
terms corresponding to complex conjugates among the X,-. 
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Example 6 

In Case 2, Chap. 1, we have 



and the characteristic numbers satisfy the equation 

M-X/|= ‘ I = + ^-X-(-^2 = 0 

W “"a — A ] 

As a matter of fact, in this case, we have obtained the transforma¬ 
tion matrix B explicitly (see E(is. (22) of Chap. 1|. 

B = 

The u equation is given by Kqs. (U) of Chap. 1 with 

The construction of the transformation matrix B in this two- 
dimensional case can be generalized to the «-dimensional ca.se to 
yield a proof of the diagonalization theorem (Theorem 2) in 
general. 

♦ ♦♦♦♦♦♦ 

In exceptional cases, Eq. (50) ha.s repeated roots. In such a 
case, A is, in general, not similar to a diagonal matrix. On the 
other hand, for the purpose of solving the differential equations 
it is not nece.s.sary to uncouple the system (45) completely. If 
we can uncouple it in one direction (up or down) then the solu¬ 
tions are readily ol)tained. To this end we again turn to a 
theorem of matrix theory. 

Theorem 3 

Given an n-by-n matrix A, there exists a nonsingular matrix B 
such that E = BAB-^ is a triangular matrix of the form 
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( Xi 0 0 • • • 0 0 \ 

^21 X 2 0 • ■ ■ 0 ® I 

^31 /332 X 3 • • ■ 0 0 j ( 53 ) 

0nl 0n2 * * ■ iSn(pi_l) X„/ 

Clearly, the characteristic numbers of E (and hence of ^4) are 
the entries along the diagonal of (53). Some may be repeated. 
The system (48) becomes 


dvi 

di 

dtii 

dt 

duz 

dt 


= XiUi 

= + X 2 M 2 

= /SsiWl + ^ 32^2 + X3M3 



du„ 

dt 


- 0nlWl + ^„2W2 + • • ' + ^«(„_l)W(n_l> + X„M, 


Integrating the first of these, we have for Ui 

Ml = Cie^“ 

with Cl arbitrary. Substituting this into the second equation 
of (54), we have 

du2 


or, what is the same, 


dt 


du 

~di 


= cu32i€^‘‘ -f- X2U2 


“ X2«2 = Ci^2,e^‘' 


(55) 


Equation (55) is a linear equation whose general solution is 

C 

^ X, —^X 2 == + C 2 e^»' (56) 

if Xi 7 ^ X 3 , or 

Ws = Ci^2i(c^'* + C2c’'>' = + C2e^“ (57) 

if Xi = Xa, with ca arbitrary. In a similar way, the third equation 
of (54) is solved using either (56) or (57). The result is a linear 
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combination of the three exponentials e*‘', and or, 
if roots are repeated, of appropriate i multiples of the distinct 
exponentials. In general, each u component consists of a linear 
combination of the exponentials . . . , c^-', corroponding 

to the n characteristic numbers, or of a linear combination of the 
distinct exponentials witli polynomial coefficients in /. 'i’he 
maximum degree of any polynomial coefficient is one loss than the 
multiplicity of the corresponding characteristic number. Cloarlv 

% t 

the solutions of Eq. (45) (given through (47)j arc of the same 
form. Hence, we have Theorem 4. 

Theorem 4 

Each component of each solution of the nth-order sy.stem (45) 
is a linear combination of the exponentials c^'‘, .... 

corresponding to the k < n distinct characteristic numbers 
Xi, Xj, . . . , X* of the matrix .4, with polynomial cooflicients in t. 
The maximum degree of any polynomial coelficient is one less 
than the multiplicity of the corresponding characteristic number. 
In particular, if A has n distinct characteristic numbers, then 
each component of each solution of (45) is a linear combination 
of the exponentials e^'', c**', . . . , e*-*' with constant coefficients. 


Example 7 


In Case 3 of Chap. 1 we were concerned with the second-order 
equation 

d^x ,i,dx /k\ 

dt^ ( 2 ) ^ ® 

whose characteristic numbers Xi and Xj were both equal to 
— k/2. The transformation matrix B implied by Kcj. (24) of 
Chap. 1 is 


B = 


6)' I 


0 
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When applied to the vector equivalent of the second-order equa¬ 
tion, the system became 

du k 

dv k 

2 *' 

(see Eqs. (25) of Chap. 1). This system is of the form (54) with 
Xi = X 2 = —fc/2 and /S 21 “ 1. The process used in this two- 
dimensional case to uncouple one equation from the other can be 
generalized to yield a proof of the triangularization theorem 
(Theorem 3), in general. 


EXERCISES 

1. Show that the inverse of a matrix B = ( 6 ^) is given by 
{Pij/\B\), where |5,> is the cofactor of 6 ,.. 

2 . Using Exercise 1, show that if the principal matrix solution 

of (38) is bounded, as and if trace A{s}ds > m for 

some number m and all t > 0 . then the inverse of the principal 
matrix solution is bounded as f . 

3. Apply the result in Exercise 2 to the special cases of con¬ 
stant A in (45) and the nth-order equation (23). 

4. Show that matrices A and E = BAB-', where B is non¬ 
singular, possess the same characteristic numbers. In fact, 
show that the characteristic polynomials \A — X/| and \E — X/| 
are identical. 

5. Prove the diagonalization theorem (Theorem 2). Show 
that eigenvectors of a matrix A, i.e., nontrivial solutions of (51), 
are linearly independent if they belong to distinct eigenvalues 
(characteristic numbers). Discuss this result as a purely alge¬ 
braic question and, in turn, as a purely geometric question. 
Then show that if an n-by-n matrix A has n linearly independent 
eigenvectors, these vectors form a base for complex n-space. 
Hence, regarding A as a Iransformation matrix relative to the 
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coordinate system x, show that relative to the cigencoordinates 
u = Bx, the equivalent transformation matrix becomes BAB-' 
and IS necessarily a diagonal matrix. Finally, extend the result 
to a singular matrix A with n distinct characteristic numbers. 
Note that A - </ is nonsingular for sufficiently small lej. 

6. It is clear that for a diagonal matrix, the trace of the matrix 
is equal to the sum of its characteristic numbers. Prove this for 
the general case by considering the factorization of the character¬ 
istic polynomial. 

7. Using Exercises 4 and (i, explain why trace .! = trace B if 
A and E arc similar matrices. Use this result and Theorem 1 to 
show that the determinants of the principal matrix .solutions of 
(45) and (48) are identical. 

8. Explain why U in Theorem 2 is the principal matrix solution 

of (48) and why the components of solutions of (45) arc linear 
combinations of the exponentials . . . , 

9. Prove the triangularization theorem (Theorem 3). Show 
that there is a base for complex n-space such that the matrix 
equivalent of A relative to this base is of the form (53). The 
geometric concept of an underlying transformation (irrespective 
of coordinate representation) proves helpful. Proceed via 
mathematical induction on the dimension n of the matrix A. 
Show that if any eigenvector of the transformation is chosen as 
the first basic vector, llien the triangularization process for A is 
reduced to that for a matrix of dimension k — 1. 

10. Using Theorem 4, discuss the behavior of a solution of 
(45), as X, in terms of the characteristic numbers of the 
coefficient matrix A. Note, in particular, the degenerate cases 
wherein one (or more) of the characteristic numbers is (are) zero. 
Note also the cases wherein multiple pure imaginary character¬ 
istic numbers occur. Illustrate the several possibilities by con¬ 
structing appropriate examples. 

11. Let X be a root of the nth-degree algebraic equation 

/(^) — X" -F fanX"”* + ■ . ■ _ Q Qf multiplicity fc > 1. 
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Show that each of x = t = 1, — 1) is a solution 

of the nth-order dififerential equation 


d’^x , I d"“^x 

dr ^ " dl”^^ 


+ * * * + h\x = 0 


Note that each of the derivatives /’(X), t = 1, . . . , (fc — 1) 
vanishes if X is a root of / of multiplicity k. Construct a base for 
all solutions of the differential equation. Then construct a 
fundamental matrix solution of the associated matrix differential 
equation. 

12. Show that x = is a solution of the system dx/dt = Ai 
{A constant) if X is an eigenvalue of A and c a corresponding 
eigenvector. Discuss the connection between this result and 
Theorem 2. 


4 . Linear Systems with Periodic Coefficients 

We are concerned here with one very general theorem which 
characterizes the form of the solutions of linear periodic systems. 


Theorem 5 


Let Y{t) be the principal matrix solution of the n-by-n-matrix 
equation 


dt 


= Pit) X 



where P{t) is a continuous periodic matrix of period r 0. 
Then Y(t) is of the form 

Vit) = Qit) (59) 


where B is a constant matrix and Q(t) has period t. 

Proof: First of all, we recall that the symbol denotes the 
principal matrix solution of an equation 


dX 


BX 


dt 


(60) 
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where B is a constant matrix. Thus (59) asserts that Y(l) is the 
product of a periodic matrix and the principal matrix solution of 
a related linear system with constant cocfiicients. The matrix 
X(t) = Y{t + r) clearly satisfies (58), and hence, 

Y(t + r) = )'(/) C 

for a suitable constant matrix C. Since C = l’"'(0 YU + ’•). it 
is nonsingular and can be expressed in the form 

C = (Cl) 

for a suitable matrix B. (This is not an altogether trivial fact. 
See Exercise 13.) Thus, we have 

r(( + r) = r(0 (G2) 

Letting Q{t) = Kfl) c'®* (63) 

it follows from (62) that 

Qil + t) = Yit + t) = y(0 = r(0 f-»' 

= Q{t) 

Hence (3(0 has period t and (63) is merely another expression 
of (59). 

It is of interest to observe that Q{t) satisfies the equation 

^ = PW Q-QB (G4) 

Thus B is a matrix such that the above matrix equation possesses 

a periodic solution of period t. But this matrix equation is 
equivalent to a linear system of order with periodic coefiicients 
of period t. In vector form, the latter might be written as 
dq/dt = P*(0 where P*{t) is periodic with period t. This 
system of order n* is to possess a periodic solution of period t. 
In general, there will be numerous choices for B. This is clear 
from (61) since C does not determine B uniquely. The “expo¬ 
nent" Br, as it were, is one of the complex “logarithms” of 
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Example 8 

In the scalar case, Eq. (58) becomes dxfSX = p(0 x with general 
solution x(/) — c exp [/o' pCs) rfs j for arbitrary c. Equation (64) 
becomes dqfdX — (p(<) — b]q with general solution 

q{t) = go exp [p(s) - b] rfs] 

for arbitrary go. 

Clearly, q{t) has period t if Jj (p(s) - 6} ds = 0, or what is the 

1 f' 

same, if ^ “ A P(®) To the latter one may add any 

integral multiple of 2iri. 


Example 9 

Consider the linear equation (Hill's equation) 

W2r dr 

+ pi(<) ^ + P2(0 X = 0 (65) 

in which the coefficients pi(<) and pzit) are continuous and have a 
common period r. A nontrivial solution x{t) of (65) is called a 
normal solution if 

x(f + r) = ffx(0 (66) 

holds identically in t for a suitable (complex) constant <r. Typi¬ 
cally, there exist two values of <r (called characUrisHc multipliers) 
for which there are corresponding normal solutions. In fact, if 
Xi(<) and X 2 (/) are any given base of real solutions of (65), then each 
of xi{i + r) and xi{l -b t) is a solution of (65) and so 


x\{t + t) = aiixi(0 H- Oi2Xj(0 
Xi(« -b r) = O 2 iXi (0 -b < 122 X 2(0 



for suitable real constants on, a^, 021 , and 022 , not all zero. Any 
normal solution x(0 may be expressed in the form 


x (0 = a:iXi (0 + a2X2(0 


(68) 
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for suitable complex constants ori and oj (not both zero). Thus, 
if + t) = (Tx(/), (07) and (08) imply thatcrai = Q,a,, + a.aii, 
<702 = QiUi 2 + 02022 , OP whut is the same 

ai(aii — a) -f- 0-021 = 0 
ttiOjs “b 02(022 — (t) = 0 

If this system is to possess a nontrivial solution (oi.o-), then the 
determinant 

— <J 021 
O12 O22 — <T 

must vanish. Thus, <t is necessarily a root of a certain quadratic 
equation. On the other hand, if (t is a nonzero root of tliis 
quadratic equation, one may retrace the above steps to (GO) and 
therein exhibit a normal solution. Thus, normal .solutions 
always exist since the quadratic polynomial (00) must process 
nontrivial roots (see Exercise 4). When (00) posses.«es distinct 
roots, there are two linearly independent, normal solutions, and 
hence the properties of all solutions arc reflected in these two 
normal solutions. In particular, for \a\ > 1, a normal solution 
satisfies lim \x(t)\ = co, and for j^l < l, Hm |a-(()l = 0 Onlv 

for (T = 1, of course, i.s a-(/) periodic witli period r. I'or a = -1. 
a-(0 is periodic with period 2t. Periodic solutions of period t or 
2 t arc actually uncommon. 

Example 10 

Consider the special Hill’s equation 

d’X 

+ p(0 x = 0 (70) 

where p(t) is continuous and periodic with period t. Then the 
determinant (G9) of the previous example becomes 

<7- — + 1 



( 71 ) 
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with “a” real. In fact, the constant term in (69) is the determi¬ 
nant 

flu flu 
fll2 fl22 



which, in turn, is equal to the determinant of the transformation 
(67). On the other hand by Eq. (34), the Wronskian of any two 
solutions of (70) is constant; i.e., the first derivative does not 
appear in (70) and so trace yl = 0, and since the Wronskian of 
the pair xi{t -H r), X 2 {t r) is the product of the determinant (72) 
and the Wronskian of the pair Xi((), X 2 {t), necessarily 


flu 

fll2 



Now the roots <n and o-j of (71) satisfy the relation o-itrj = 1. 
Thus, some solutions of (70) are unbounded whenever one of l<ri| 
and l<r 2 l is greater than 1 or, what is the same, less than 1. Only 
in the case 


kil = 1 

M = 1 



is it possible for all solutions of (70) to be bounded. Since the 
roots are given by 



(73) occurs if and only if (fl/2)* > 1. Generally, if o-i = 0-2 = 1, 
or <Ti = <T 2 = —1, then some solutions are still unbounded. 
Thus, typically all solutions of (70) are bounded if and only if the 
characteristic multipliers are nonreal. It is of interest to note 
that the special circumstances a/2 = a i = ae = 1 or <ri = <r 2 = — 1 
are the onlj' cases wherein periodic solutions of period r or 
2t exist. Thus, those cases wherein such periodic solutions 
exist correspond to boundaries between stable and unstable 
phenomena of (70). In the case of the Mathieu equation, 
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+ (w* + € COS /)x = 0, only for very special pairs of 
values of (w*,e) do periodic solutions with period 2w or 4ir exist. 


Example 11 

Actually, the situation depicted in Example 10 is not too 
special. For although Eq. (70) appears as a special case of the 
more general Hill’s equation (65), the solutions of the latter are 
reflected in a related equation of the form (70). In fact, the 
substitution 

1/(0 = x(0 exp // Pi(s) ds] (75) 


transforms Eq. (65) to 





provided pi(0 is continuously differentiable. But if pi(0 and 
PiiO have period r, then the coetticient of y in (76) also has period 
T and (76) is of the special form (70). 

If (75) is applied to the equation 


— + 


A: ^ + («' + t cos 0 X = 0 



where is a constant, tliere results the equation 

^ + (w' - + . cos () i/ = 0 

which is the Mathieu equation with w* replaced by w* — (it/2)*. 
In this case, x(0 = y(0 so that for small k, the efTect of the 
damping term in (77) is quantitatively similar to the effect of a 
corresponding damping term for an equation with constant 
coefficients. 


EXERCISES 

1. With reference to Theorem 5, explain why the principal 
matrix solution satisfies Y{1 t) = Y{1) C for a suitable constant 
matrix C. 
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2. Regarding Q{t) in Theorem 5 as a transformation matrix, 
explain why the system (60) is equivalent to the system (£ 8 ). 

3. Discuss the form of the solutions of the vector equation 
dx/dl = P{t) X as implied by Theorems 4 and 5. In particular, 
note the form of the solutions when the matrix B of Eq. (60) is, 
or is equivalent to, a diagonal matrix. 

4. Give a justification for the “expansions” in (67) and ( 68 ). 
Explain the derivation of the quadratic polynomial (69) and 
show that ff = 0 is never a root. 

5. Show how to exhibit a normal solution of (65) which corre¬ 
sponds to a root of the quadratic in (69). 

6 . Show that normal solutions of (65), corresponding to two 
distinct characteristic multipliers, are linearly independent. 

7. Show that each normal solution x{t) of (65) may be expressed 
in the form x (0 = qit) with 5(0 periodic of period r and 5 a 
suitable (complex) constant. The latter is called a characteristic 
exponent of (65). Discuss the relationship between this form of 
solution and that implied by Theorems 4 and 5 . 

8 . Discuss the nature of the solutions of (65) as reflected in its 
characteristic exponents. In particular, discuss the solutions 
of the special Hill's equation (70). 

9. Show how to construct real solutions from nonreal normal 
solutions of (65). 

10. In connection with Example 10, explain why the Wronskian 
of the pair Xi(t + t), x^it + r) is the product of the determinant 
(72) and the Wronskian of the pair Xi((), X 2 {t). Explain why the 
Wronskians are not zero and the significance of this fact in the 
discussion of (72). 

11. Derive (64) and (76). 

12. Apply (75) to the equation 

+ 2 * sin (-j- (o)* + € cos i)x = 0 
and express the result as a Mathieu equation. 
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13. Show that if C is a nonsingular matrix and r is a real 
number different from zero, then there exists a matrix B such that 
C = [This is to justify (61).) First, note that according to 
Theorem 3, one may assume C is a triangular matrix. For if 
C = then TCl'-^ = (Prove this result 

and explain the significance.) Observe that 

(b, OV ^ 0 \ 

yhs bi) \6j(6i + 63) 63*/ 


and, more generally, 

/6i OV ^ 0 \ 

\bi bz) \biPk 63*/ 



where Pjc = 61 *"“* + ’63 + • • • + b\bz‘ * + 63 * ’. 

plain how to choose the matrix 


so that 



k 


Then ex- 


for given cj, cj, and C 3 with ci 0 and C 3 ^ 0. Explain why this 
proves the desired result for n = 2. Finally, extend this tech¬ 
nique to a proof (via mathematical induction) for the general 
case.* 

14. Let 2(0 be a normal solution of (70) which does not vanish 
for any t. Then (70) may be expressed in the form 


jd^x/dP) 

X 


+ P(0 = 0 


Use this form to show that ^ p(0 dt = — [{dx/dty/x^\ dt, 
where t is the relevant period of p{t). Hence if p{t) dt > 0, 

* Richard Bellman, "Stability Theory of Differential Equations," pp. 
29-31, McGraw-Hill Book Company, Inc., New York, 1953. 
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necessarily x{t) is a nonreal normal solution. Explain the 
significance of the latter fact. 

15. Let x{t) be a real normal solution of (70) which vanishes 
at <1 and ti, with 0 < li < iz < t, but is positive on the interval 
i\ < i < < 2 . Let x(0 assume its maximum for this interval at 
h. Then explain why 

1 , 1 ^ [ x(<3) - a:(fi) _ xjh) - x(f3)1 1 

^3 t2 ~~ H [_ fs ~ t\ ii — (3 J a:(/ 3 ) 

/dx\ __ /^\ 
x{tz) 

where {dx/dt)i and {dx/dt)^ denote values of the derivative dx/dt 
for suitable I in the interval h < t < U. Further, explain why 


and why 



Thus, show that if 1??(01 dt < 4/t and if x{() is a normal solu¬ 
tion of (70) which vanishes for some t, then necessarily x(t) is a 
nonreal normal solution. 

16. Using Exercises 14 and 15 and a result derived in Example 
10, show that all solutions of (70) are bounded ast—* » provided 

fj Pit) dt>0 and Jj |p(0! dt < 4/t. We assume here that 
p{l) does not vanish identically. 

17. Apply the result in Exercise 16 to the Mathieu equation. 

18. L'^se a technique introduced in the first set of exercises of 
this chapter to construct a “second” (generally nonnormal) solu¬ 
tion of (70) when (71) possesses a double root. Explain why this 
solution typically is not bounded. 

19. Let Xi(0 in (67) be a normal solution of (65) corresponding 
to a characteristic multiplier tr and a period r of (65). Show that 
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for xiO) 7^ 0, the ratio R{t) = X 2 ( 0 /xi (0 satisfies the difference 
equation 


R{t + r) 



From this, show that for each integer A: = 1, 2, . . . , we have 

+ (fj Hit) 

and that 

XzCf + kr) = + ■ ■ ■ + + 022^x2(0 

Note that the latter is true also for xi(0 = 0, and hence, quite 
generally true. Explain why 

X2(f -f kr) = ka2io^~'xi{t) + 

if (T is a double root of the quadratic (09) and if, in addition, 
.ri(0 is periodic, why 

Xt{i + kr) = ka 2 iXi{t) 4- X2(0 
Thus, unless 021 = 0, X 2 {t) is not bounded. 


5 . AsyynptoHc Behavior of Solutions of Linear Systems 

Here we are concerned with the ultimate behavior of solutions 
of a linear equation. In particular, we ask: 

а. Are all solutions of the equation 

1 /.s 

■^ = ^( 02 : (78) 

bounded as / —+ « ? 

б. Do all solutions of (78) approach zero as f —♦ » ? 

We, of course, assume that A{() is defined and is continuous for 
all i > 0. 
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Since the general solution of (78) may be expressed in the form 

x(0 = Yit) c (79) 

where y’(/) is the principal matrix solution, questions a and b 
concern the ultimate behavior of the principal matrix solution 
itself. Thus, all solutions of (78) are bounded or approach zero 
as » oc if and only if the principal matrix solution K(<) is 
bounded or approaches zero as / ^ « . 

Two important cases of (78) were considered in the previous 
sections. If .<4(0 is either a constant matrix yl* or a periodic 
matrix P{t), then the principal matrix solution is of the form 
}'(0 = Q{t) with either Q(0 constant and B = -4* or Q{t) 
periodic. Thus, the ultimate behavior of >'(0 is reflected in the 
set of characteristic numbers of B (or A*). In particular we 
have; 

c. If the real part of each characteristic number is negative, 
y{l) approaches zero as < —» «. 

d. If the real part of at least one characteristic number is posi¬ 
tive, l'(0 is unbounded as / —» ». 

Any statement concerning mere boundedness of 7(0 would 
necessarily be less categorical than c. On the other hand, d does 
not characterize the unbounded case. 

Other cases with which we are particularly concerned are those 
in which (78) is ultimately near one of these two types; that is, 
A (0 is asymptotic to, or approximately equal to, either a constant 
matrix .1 or a periodic matrix P{t) as t—* The results are 
expressed in a number of comparison theorems, and it will bo seen 
that comparison is generally effective only if the approach to the 
asymptotic form is sufficiently rapid. 

If lim A{1) = .4*, where A* is a constant matrix, it is natural 

to expect that as t—* «, the solutions of (78) would resemble 
those of the equation 


dx 
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On the other hand, the perturbation matrix B(t) = A{t) — A*, 
acting over a large interval of time, can induce large variations 
in the expected behavior, even though B{t) is small and tends to 
zero as i—* x. The question arises as to the meaning of the 
adjective small when applied to B{t) for t—* *. The matrix 
B{t) may be thought of as arising from some form of parametric 

excitation. The quantity l^lB{s)\ds, therefore, is an index 

of the maximum impulse imparted to the system through para¬ 
metric excitation up to time t. If this were unbounded as a 
function of t, arbitrarily large variations in the responses might 
certainly be expected. Thus, it is reasonable to define “small 

parametric excitation” to mean |S(s)|rfs < *. This is a 

rather strong form of lim B{t) = 0. In such a case, we shall say 

that B{t) is impulsively small as t—♦ «. With this reasonable 
meaning of “smallness” we have Theorem G. 

Theorem 6 

If all solutions of (80) are bounded as / —» «, the same is true 
of (78), provided the difTerence B{t) = ^1(0 - A* is impulsively 
small as t -♦ cc. If all solutions of (80) approach zero as / —»«, 
the same is true of (78), provided | Bit) | < c for suHiciontly small 
(positive) c, depending upon A*. 

Proof: Equation (78) may be written in the form 

= A*x + B(t) X 

Regarding B{i) i as a forcing function, we have from (44), 

x(l) = y(() c + Y(t - s) B(s) f(s) rfs (81) 

where Y{t) is the principal matrix solution of the associated 
matrix equation dX/dt = A*X, and c is an initial vector. The 
hypotheses of the first part of the theorem imply that 7(1) is 
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bounded as ^ » «. Thus, we have 

|i(0| < ci|c|+ /o*Ci|B(s)||x(s)|(/s 

where Ci = max | 7(0 ]. Applying Gronwall’s lemma, we have 

o<<<« 

further 

I x(t) I < Cl I c I exp [c, I B{s) I ds] 

Thus, the boundedness of | ^Cs) | ds ensures the boundedness 

of x{t). For a proof of the second part of the theorem, we bring 
to bear the strong exponential decay property of 7(0 which is 
implied by the hypotheses. In fact, there exist positive constants 
a and Ca such that 

I 7(0 I < cae-* (82) 

for alU > 0. (- a might be taken as the largest of the real parts 

of the characteristic numbers of A.) Then from (81) we have 

I i(0 I < I c I ^26'“' + /o* CjC-«<'-*> 1 B{s) 11 x{s) I da 

or, what is the same, 

|| x(0 I c“‘] < I c I Ca + /q* ca I B{s) \ [| x(s) | e“*] da 
Hence by Gronwall’s lemma, 

[| x(0 I c*"] < I c I Ca exp [ca \ B{s) \ ds] 

or, what is the same, 

I x(0 I < I c I Ca exp [ca \ B{s) | ds — ai] (83) 
Thus if I B(0 I < c < a/ca, (83) implies that 

|x(0| < |c|cac‘^^“» 

with (cac - a) < 0, and so Urn x(0 = 0. Finally, we note that 
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the bound ajci for |^(0| depends upon the principal matrix 
solution F(0 which, in turn, depends upon the constant matrix 
A* [see (82)). Thus the area of application is determined solely 
by the approximate asymptotic form of the equation. 

The second part of Theorem C implies that the system can 
absorb a total infinite impulse provided the system is positively 
damped and the impulse is imparted to the system at a suffi¬ 
ciently slow rate. Such a result is, of course, to he expected. 
The expected also occurs in the inhomogeneous case. By similar 
arguments we can prove Theorem 7. 

Theouem 7 

If all solutions of (80) are hounded as / —► k , then the same is 
true of the inhomogeneous equation 

‘^ = .1 (0 .f +/(() (84) 

provided each of h{t) = A{1) - A* and J{1) is impulsively small 
HR t—* i.e., 

|/i(0|t//< CO and /o"|/(0|df< x 

If all solutions of (80) approach zero as f —♦ « , tlicn all solution.s 
of (84) are hounded hrI—* « provided/(/) is hounded as / —» x 
and B{1) is impulsively small ns I—* x . 

Proof: Using (44), we have, for any solution of (84), 

Hi) = Y(l) c + !'(( - s)\I3{s) f{s) + /(«)) ,1s (85) 

where l'(0 is the principal matrix solution of dX/dt = .1 *A', and 
c is an initial vector. The hypothe.ses of the first part of the 
theorem imply that 

|i(0 I < ci|(:| + [ci|B(s) ||i(s) | + Ci|/(s) || ds 
for a suitable positive constant ci. Applying GronwaH’s lemma, 
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we have further 

I x{t) I < C 2 exp j^ci I B(s) I ^ 1 

where C 2 is any positive constant, not smaller than Ci | c |. Thus, 

x (0 is bounded as (—» « if each of | B(s) | ds and |/(s) | ds 

is. For the proof of the second part of the theorem, we first 
consider the asymptotic form of the equation 

§ = 4*S+/(0 ( 86 ) 

According to (44), 

s(l) = /„' Y{t - a) /(») da 

is a solution of ( 86 ) and since the hypotheses of the second part of 
the theorem imply that | Y{t) | < CaC"®' and |/(0 | < d for suit¬ 
able positive constants Ca, C 4 , and a, we have 

I y{t) I < C3C4 P ds = —{l- e-“‘) 

Jo a 

Thus, y(0 is certainly bounded as < . On the other hand, if 

we subtract ( 86 ) from (84) and let 2 = 5 — y, we obtain for I, the 
linear equation 

^ = X(() 2 + B(0 y (87) 

with B(t) y as a forcing function. Since y is bounded and B{t) is 
impulsively small as < —» , it follows that the product B{t) y is 

impulsively small as f —» «. Thus, the hypotheses of the first 
part of the theorem arc fulfilled in Eq. (87), and we conclude that 
every solution I is bounded as «. Clearly then, every 
solution X — 2 -|- y of (84) is bounded as < —> ». 

Example 12 

All solutions of the equation d^x/dt^ + [1 + 1/(1 + = 0 

are bounded as i —» «, 
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Example 13 

There are unbounded solutions of the equation 

+ (1 + t cos Ox = 0 

for every 1<1 sufficiently small.* 

Example 14 

If k > 0, then all solutions of tlie equation 



tend to zero as / —♦ «. 


Example 15 

If A: > 0, then all solutions of the equation 

d}x , kdx , ,, , 

dO + + (1 + t cos Ox = 0 

tend to zero as I—» « provided |t| is sufficiently small. 

Example 16 

All solutions of the equation c/*x/d/* + (1 + 1/(1 + /0]x = e“' 
are bounded as t—* «, 

Example 17 

If fc > 0, then all solutions of the equation 



are bounded as i —» <». 

* N. W. McLachlan, “Theory and Application of Mathieu Functions,’’ 
Oxford Univereity Press, New York, 1947. 
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Example 18 

There are no bounded solutions of the equation 


(see Exercise 4). 


EXERCISES 

1. Explain the statements in c and d and the relevance of c to 
the inequality (82). 

2. Discuss the signiBcance of each of the Examples 12 to 18 
in relation to Theorems 6 and 7. In particular, indicate those 
instances of direct application of the theorems and those instances 
where direct application is not justified. For the latter, explain 
why the theorems are not germane. 

3. Introduce the change of variable (75) in each of Examples 
14 and 15, and explain why these cases are (or are not) covered in 
Examples 12 and 13. 

4. Using the technique introduced in the proof of Theorem 7, 
show that there are no bounded solutions x of the equation 
d-x/di- + [1 + 1/(1 + /*)]x = cos t. In fact, show that if ?/ is 
any solution of the asymptotic equation d-y/dt- + y = cos t, 
then the difference z — x — y satisfies a linear equation which 
admits only bounded solutions. Explain why this proves the 
desired result. 

5. Show that for < > 0, x = t sin t satisfies the linear equation 
d'^x/dt^ — {\/t)dx/dt + (1 + \/t^)x = 0. Explain the signifi¬ 
cance of such an example. 

6. Introduce the change of variable (75) in the equation 
d-x/dt^ -b (1/0 dx/dt -b x = 0, and then use Theorem 6 to show 
that every nontrivial solution for / > 0 tends to zero as 

Note that the decay is not of the exponential type, however. 
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7. Show that each nontrivial solution of the equation 

for f > 0 is unbounded as / —» «. 

If ill (78), .4(/) is asymptotic to a periodic matrix Fit) as 
X, we use the representation theorem, Theorem 5, lo prove 
Theorem 8. 

Theorem 8 

If all solutions of the periodic system 

= P{1) i (88) 

at 

are bounded as / —» then the same is true for (78), provided 

the dilTerence ("(0 = .1(0 - Fit) is impulsively small as /-> x. 
If all solutions of (78) approach zero as then the same is 

true of (88) provided | C(0 | < c for sufficiently small (positive) 
c, depending upon the approximate asymptotic form (88). 

Proof: Let ITO = Q(0 he the principal matrix solution of 
dX/iU = FH) X, where Q(0 is periodic. Then (78) may be 
expressed in the form 

^ = P(t) X + C{() X- 

and for any solution, we have from (43), 

xii) = Yit) c + /^' IT(0 y-'{s) Cis) i(s)] ds 

= >^(0 c + (Q(/) c®'c-®*Q-'(s) C(s) ^(s)l ds 

where c is an initial vector. Hence 

I m I < 1 Yit) c I + U Qil) 11 11 Q-'is) 11 ds) 11 i-(.) I ds 

(8t)) 
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Now, the inverse of the periodic matrix Q{t) — (qM) has for its 
ijth element, the quantity pi>(0/i0(0L where p.XO is the cofactor 
of g>,(0. Further, since the determinant \Q{1)\ is periodic and 
does not vanish, it is uniformly bounded away from zero. Thus, 
along with Q{t), the inverse Q“*(0 is uniformly bounded for ( > 0 
and the inequality (89) may be replaced by 

I i(<) I < I K(0 c I + Cj I 11 C(s) 11 5(s) I ds (90) 

for a suitable positive constant C 2 . If all solutions of (88) are 
bounded, then (90) in turn yields 

|x(0 I < Cl |c| + C 1 C 2 ^'1 C'(s) ||i(s) |rfs 

for a suitable positive constant ci. Thus, by Gronwall’s lemma, 
we have 

M(0 I < c,|c|exp [ciC 2 f^\C{s) |dsj 

and the condition |C(s)|ds < « implies x(0 is bounded as 

/ —* oc. On the other hand, if all solutions of (88) approach zero 
us X, then there exist positive constants Ca, Ci, and a such 
that 

I e®' I < cac-®' and | l'(/) | < C4C““' 

Thus, (90) implies that 

I m \<Ci\c\ e-“' + C 2 C 3 1^' I C(«) 11 x(s) | ds 
or, what is the same, 

|| x(/) I c®'] < C41 c I + C 2 C 3 I C(s) 1 1| x(s) I e“‘] ds 
By Gronwall’s lemma, therefore, we have 

l|x(0|c“'] < C4|c|cxp [c-ca /o*|C(s)|ds] 
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or, what is the same, 

|x(/)| < c,|t'|cxp [cjCj |C(s)|(/s - Q/j 

Thus, if I C{s) \ <c< a/{ciCz), then lim j(0 = 0. W'e note that 

(—• 0 

each of the positive constants cj, Ca, and a depends solely upon 
the principal matrix solution of the approximate asymptotic 
(periodic) form (88). 

Example 19 

If A: > 0, then all solutions of 

approach zero as f « provided \p{t) - €Cost\ < c for suffi¬ 
ciently small c and |el. Note that p{t) need not be periodic, but 
if it is, e cos t might be the fundamental in a Fourier expansion 
of pit). 

In view of Theorems C and 8 one might anticipate some rather 
general comparison theorems. For example, if all solutions of 
the equation 

^ = ^(i) i (91) 

are bounded as (—» «, then does it follow that all solutions of 

^ = 1.4(0 + m\i (n2) 

are bounded as / —► x provided |/i(/)|(/( < x? Such is 

not the case, as may be seen by examples. One cannot even 
conclude in general that all solutions of (92) are bounded if all 
solutions of (91) approach zero as (—♦ x.» However, if the trace 


* Bcllmao, op. cil., pp, 42-43. 
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of the coefficient matrix A{t) is sufficiently well behaved as 
f , then general comparison theorems of the above type are 
available. The following is an important illustration of one such. 

Theorem 9 

If all solutions of (91) are bounded as f —> », then all solutions 
of (92) are bounded as «-♦ co provided B{i) is impulsively small 

as / —» 00 and ^ trace .A(s) ds is bounded away from — oo as 
+ 00 . 

Proof: Again using (43) we have, for any solution of (92) 

x(() = Y(t) c + [Y(l) F-'(5) B(s) x(s) 1 ds 

where >^(0 is the principal matrix solution of the equation 
dX/dt = /1(0 A^ and c is an initial vector. Hence 

I m I < k(0 c-1 + 1 Y(l) 11 r->(s) 11 B{s) 11 x{s) I ds 

The hypotheses imply that jlTOl = exp trace A(s)ds] is 

bounded away from zero, and this, in turn, implies that | K“'(0 | 
is bounded as (« if | Y(t) | is. Thus, if all solutions of (91) 
are bounded as f —> oo, then 

M(/) I < ci|c| + C 2 1-6(5) II x(s) \ ds 

for suitable Ci > 0 and C 2 > 0 and by Gronwall's lemma, 

I i'(0 I < c, I c I exp [c 2 I B(s) I ds] 

Hence x{t) is bounded as « provided B{t) is impulsively 
small. 

Example 20 

For the equation d^x/dt^ + a(0 x = 0, trace A{t) = 0, so that 
Theorem 9 in this case is an extension of the first part of Theorem 
8 which concerned only the periodic case. 
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Example 21 

If la(0l then there are linhouiidod solutions of thp 

equation d-x/dt- + aff) x = 0. In fact, the vector version of 
this equation di/dt = .!(/) x relates to the matrix 



and if all solutions were bounded. Theorem 9 would assert that 
all solutions of dx/d( = A{t) x + B{t) x, with 


B{t) = 

would 1)0 bounded. But this is impossible since the scalar 
version of the latter isd^x 'dl- = 0. 



Theorems 8 and 9 (and parts of G and 7) are each special case."; 
of the rather general Theorem 10. 

Theorem 10 

If all solutions of (91) and its adjoint system dz'/dl = ~z' A (0 
( 2 ' is a row vector) are bounded as / , then all solutionsof (92) 

are bounded as t-» x provided B{t) is impulsively small as 

/ ^ X. 

Puoof: A proof, similar to that of Theorem 9, may be based on 
the observation that all solutions of the adjoint system are 
bounded as t —» x if and only if the inverse of the principal 
matrix solution TfO of dX/dt = A(0 X is bounded as /x. 
Tor ^"'(0 is the principal matrix .solution of the adjoint system. 

I'lXERCISKS 

1. What theorems of this chapter are required to justify the 
statements in Example 19? 

2. Explain the statements made in Examples 20 and 21. 
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3. Show that each of Theorem 8 and 9 (and a part of each of 
6 and 7) is a special case of Theorem 10. 

4. Show that any solution of dxidt = A{1) x satisfies |x(01 < 

|c|exp A(s) |dsj, where c is the initial vector. 

5. Show that Urn x{t) exists if dx/dt = A{t) x and 

folMs)\ds < 00 . 

6. Give a detailed proof of Theorem 10. 



Chapter 5 


STABILITY IN NONLINEAR SYSTEMS 


1. The Concept of Stability 

There arc basically three categories of the stability concept: 
Laplace, Liapunov, and Poincard. The first is of such generality 
as to be rarely useful, while the second is so restrictive that one is 
forced to introduce the third to discuss stability of periodic solu¬ 
tions properly. There are many specialized stability concepts 
which have been introduced and developed within each of these 
three basic categories. We shall be concerned with but a few of 
these. 

Laplace stability is a boundedness concept of a very general 
nature, A system is stable in (he sense of Laplace if it exlhbits 
only finite motions; i.e., all solutions of the differentiai eemations 
are bounded as x. The use of the word “stability” with 
reference to the stability regions of the Mathieu e«|uation 
invokes the Laplace concept of staihlity. Such a .stability con¬ 
cept, however, is not useful for quantitative matters in variational 
problems, .since it distinguishes variational elTects only as to their 
being finite or infinite. Tor example, any earthhound phe¬ 
nomenon is stable in the .sen.se of Laplace. 

Liapunov .stability, on tin* otli<*r hand, is concerned willi very 

stringent restrictions on the motion. It is required that motions 

{solution.s) which are once near together remain near together 

129 
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for all future time as functions of the time. Specifically, we say 
that a solution x{i) of 

§ = /(-.o (1) 

is stable in the sense of Liapunov, if for each e > 0, there exists a 
5 > 0 such that any solution y of (1) satisfying | x — y | < 5 for 
t = 0 also satisfies | x — y | < € for all f > 0. (The choice of 
initial time ( = 0 in this definition is, of course, of no importance 
to the concept.) Liapunov stability embodies much of what one 
desires in a stability concept. However, the time-dependent 
comparison, implied by the inequality |x — y| < e, often pre¬ 
cludes stability for certain steady-state phenomena which should 
be considered stable. This difficulty lead Poincar4 to the con¬ 
cept of orbital stability. 

Orbital stability is concerned with the behavior of positive half 
paths of trajectories. A trajectory T is stable in the sense of 
Poincare, i.e., possesses orbital stability, if neighboring half paths 
which arc once near F remain near F. In this case, “stability" 
does not require a comparison between trajectories as functions 
of the independent variable. Geometrically, one thinks of a 
trajectory F in 7i-space surrounded by a tubing which has the 
property that any trajectory which once penetrates this tubing 
must thereafter remain within a slightly larger tubing. If this 
is the case for arbitrarily small tubings, then F possesses orbital 
stability. If we further require that there be no “shearing” 
within the tubings so that the trajectories move down the 
tubings together, then F is stable in the more restrictive sense 
of Liapunov. 

A trajectory F is asymptotically stable (orbitally or otherwise) 
if positive half paths which are once near F actually approach 
F as t —» «. 

In the following, the words “stability” or “asymptotic sta¬ 
bility” will mean stability or asymptotic stability in the sense of 
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Liapunov and a solution will be unstable if it is not stable in the 
sense of Liapunov. 

2 . Stability of Singular Points of Autonotnous Systems 

The solutions of /(J-) = 0 are singular points (point solutions) 
of the difTerential equation 

fir" 

If c is such a point, we say that (2) is stable a/ r if j = r is a 
stable solution of (2). We may, on occasion, refer to a singular 
point c as a stable (or unstable) position of equilibrium. In par¬ 
ticular, the linear system 

dx , 
dt = 

is stable at the origin if x = 0 is a stable solution of (3). From 
Chap. 4, we know that (3) i.s stable at the origin, say, if the real 
part of each characteristic number of A is nonpositive and any 
pure imaginary characteristic number is at most a simple root 
of the characteristic equation. Kquation (3) is asymptotically 
stable at the origin if the real part of each characteristic number 
of A is actually negative. More generally, a nonlinear equation 
may have several singular points, all, none, or some of which 
may be stable. If c is a singular point of (2), we may introduce 
a new variable y - x — c and (2) becomes 

^ = /(y + c) = ]*{y) 

The singularity now appears at the origin y = 0 in the new 
coordinates. Thus there is no loss in generality if we assume 
that any particular singular point is placed at the origin of the 
coordinate system. 
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Example 1 

The scalar equation dx/di = x — possesses two singular 
points, a: = 0 and a: = 1. The latter is asymptotically stable 
while the former is unstable. With y = x — I, the differential 
equation becomes dy/di = —y — so that the stable equi¬ 
librium position now appears at the origin, y = 0 . 

Example 2 

Consider the equation dy/di = — y + y*. It may be shown 
that solutions initially near the origin tend to the origin as 
♦ 00 , while solutions initially far from the origin tend to 
infinity in finite time. Thus the origin is asymptotically stable, 
but distant solutions are not even continuable for all t > 0. 

Suppose 5 is a singular point of (2). We may express the 
right-hand member of ( 2 ) in the form 

}{x) = A{x - c) (4) 

where is a (any) constant matrix. Here is merely the 

difference/(x) — A{x — c). On the other band, suppose ^4 5 ^ 0 
can be chosen so that 

= 0 (5) 

i-c I X - c I 

Then the equation 

I = - e) (6) 

deserves the name linear approximation. The condition (5) 
(referred to as the nonlinearity condition) is a precise way of 
saying that the linear term in (4) is the dominant part of J{x) 
for X near c. Then (4) is “linearized" merely by erasing the 
second term on the right. For stability considerations, the 
latter physical process is justified by the mathematical Theorem 1. 
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Theorem 1 

If the linear approximation (G) is asymptotically stable at c, 
then (2) is asymptotically stable at c. 

Proof: Our proof will imply that solutions of (2) once near c 
remain near c and hence exist for all t > 0. With y = x — c, 
Eq. (2) may be expressed in the form 

^' = /<"(» +C-) (7) 


and the nonlinearity condition (5) may be reformulated as 




Then from (44) of Chap. 4. we infer that any solution of (7) 
satisfies an integral equation of the form 


y{t) = YU) C* + /J YU - s) /"'(i/W + c) * 

where Y{i) is the principal matiix solution of the associated 
matrix equation dX/dl = AX and c* is an initial vector. The 
hypotheses imply that 

|r(/)| < (9) 

for suitable positive constants c and a. Hence 

\m I < c |c-‘ I ' + c e-»-> \j<"(y{s) + c) |c/5 
or, what is the same, 

\y(t)\e‘‘‘ < c|c*| + + c)|e“*ds (10) 


But from the nonlinearity condition (8), it follows that there 
exists a positive number 6 such that 
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for I y I < 5. Then from (10), we have further 

[| Kl) I < C I c* I + I ] y { s ) I e“] ds (11) 

provided |^(s) | < S for 0 < s < For ^ = 0, we have |^(0) | 
< c I c* I and so if c* is required to satisfy 

|c*| < Vc (12) 

then the inequality |5(s) | ^ 5 will be satisfied on some interval 
0 < s < I with ( > 0. Applying Gronwall’s lemma to (11), we 
have 

I y{t) I < c I c* I e*"* 


or, what is the same, 

|y(0| < c|c*|e-«"* (13) 

But this shows that the inequality \y{t) | < c|c*| < 5 once 
initiated is maintained and thus applies throughout. Clearly, 
then, (13) applies for all / > 0 and so lim |y(/) | = 0. Finally, 

we note that the inequality (12) is merely a restriction on the 
initial perturbation of x(/) relative to the singular point c. 
Thus the theorem is proved. 

The requirement that (6) be asymptotically stable at c is essen¬ 
tial even for proving that the solutions of (2) initially near c 
remain bounded. In general, it is not true that the stability of 
(0) at r implies the stability of (2) at c. The above proof is 
effective in the asymptotic case because the linear approximation 
(6) ensures a tendency for perturbation amplitudes to decrease, 
thereby rendering the influence of the linear term in (4) more and 
more pronounced. At the same time, the nonlinearity condition 
ensures that this tendency for perturbation amplitudes to 
decrease is not disrupted. 
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Example 3 


The Duffing equation d-x/dt- + k dx/di + = 0 is 

asymptotically stable at the origin if k > 0. In this case we 
have the system dx/dt = .4x + /'”(•?) where 





We note that 


and so 
Example 4 


|/“’(x)| 

|i| 






lim 

i-»5 


\jyyf)j 

Ml 



For the equation d^x/dl- 4- f{x) dx^dt + o>-x = 0. we let 


A = 

'I'hen 
so that 





" ) 
- fU'AU’J 


I j| 


1/(0) -/U.)1N 

|xil + IxjI 


< LAO) -/(.r,)| 


lim 

/—a 


l.^■'(x)| 

Ml 



if /(/) is continuous. If /(O) > 0, tlie nonlinear eiiuation is 
asymptotically stable at the origin. 


(14) 


I'XAMPLE 5 

Consider the stability at the origin of the equation 

d-x , dx , /j—: 

dt^ + ^ 

Ijct A = so lhat/“>(x) = Then the 

linearity condition for /‘“(x) is not satisfied at x = 0. Indeed, 
for l^al = 0 

|/“'(x)| ^ VN ^ ^ 1 

|x| |X,| + H ^|j,| 


non- 
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It is not difficult to show that (14) is unstable at the origin, 
though that portion of (14) which is obtained by erasing the 
nonlinear term \/|xi| is, in fact, asymptotically stable at the 
origin. On the other hand, the equilibrium position x = 1 is 
asymptotically stable. In fact, letting y = x — 1, (14) becomes 



+ | + y + (i 


Hence with 



- VlFTTl) = 1 ^ 


' dl 


y 


+ (i - V\yTT\ + iy) = 0 


(15) 


and 


/"'(S) = ( 


vTyTll 


- My. - V 


the nonlinearity condition for /<-’(y) at y = 0 becomes (with 

|y.! < 1) 


\Myl\ 

\y\ 


Vl.vi + i| - Hyi - 


|yil +11/2 


il ^ iVll/i>11 - Hyi 

|yi| 

ly 


1 


^\y 


.+1I+I+1 


The latter is not greater than lyi|/2 for Iyi| < 1. Thus since 
d^yldt' + (ly/dt + (^ 2 )y = 0 is asymptotically stable at y = 0, 
(14) is asymptotically stable at x = 1. It should be observed 
that the dominant part of Eq. (15) near y = 0 is characterized 
by the nonlinearity condition and docs not consist simply of the 
linear terms of (15). 


EXERCISES 


1. Consider the linear sj'stem 

dx , 

— Oiix + Oijy 

dy , 

^ = ujix + a-iiy 


where each of the coefficients on, Ow, Ou, and an is a constant. 
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Characterize the stability of the origin in terms of the coefficients. 

2. Justify the statements made in Examples 1 and 2. 

3. Using Theorem 1 and Exercise 1, discuss the stability of 
each of the singular solutions of the nonlinear system 


dx 

dl 



U 



Find a single second-order equation which is equivalent to this 
system. 

4. Let /(x) be continuously differentiable, and let c satisfy 
/(c) = 0. Show that/(x) = /^(c) (x - c) +/“*(x), where/^(c) is 
the Jacobian matrix (5/,/dx,) evaluated for x = c and /“'(-c) 
satisfies the nonlinearity condition (5). Illustrate for the right- 
hand member of the system in Exercise 3 and for each singular 
point of the system. 

5. Show that the trivial solution of the nonlinear equation 
dH/df^ — {dx/dlY + X = 0 is not stable. U.sc the technique 
introduced in Chap. 1 and show that the quantity x^ -1- {dx/diy 
is nondecrea.'^ing along each trajectory and cannot be bounded. 
Explain the significance of such an example. 

6 . Show that the trivial solution of the nonlinear equation 
dVdf® + {dx/dty + X = 0 is asymptotically stable. Explain 
the significance of such an example. 

7. Show directly that the trivial solution of the Dufling equa¬ 
tion d-x/dy + u*x + /3x^ = 0 is stable if u® > 0. Show that all 
other solutions are unstable \i $ 7 ^ 0. Do any solutions other 
than the trivial one possess orbital stability? 


3. Stability of Singular Points of Nonautonomous 
Systems 

Using the representation theorem of Chap. 4 for linear periodic 
systems, one encounters no difficulty in generalizing the proof of 
Theorem 1 to a proof of Tlieorem 2. 
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Theorem 2 


If the periodic system 

dx 

dt 


P{t)x 


is asymptotically stable at the origin, then the system 


di 

dt 


P{t) X 



is asymptotically stable at the origin, provided J^^^{x) satisfies 
the nonlinearity condition 


lim = 0 

|x| 


i-»0 


Example 6 

Consider the equation 


Assume that /(O) = k > 0. We have the equivalent vector 
system 

where 


Pit) = 
Now 



<.^-.cos( -0 t -/(xOl J 

“r=i- 1., I I I ^ 1^ ~ fixOl 


and so if f(x) is continuous at x = 0, satisfies the non 

linearity condition. 

For small \t\, the linear equation 
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is asymptotically stable at the origin; hence, the nonlinear equa¬ 
tion is asymptotically stable at the origin. 

♦ ♦♦♦♦♦♦ 


There are many cases in which the autonomous form of the 
nonlinear term in cither (4) or (IG) is a serious restriction. It i.s 
clear from the proof of Theorem 1 that if the nonlinearity condi- 
tion (5) is replaced by 



uniformly for t > 0, then the conclusions of Theorems 1 and 2 still 
Iiold. However, this is often not enough, and in many cases the 
limit in (17) cannot be expected to be uniform for ^ > 0. If we 
strengthen the nonlinearity condition somewhat .><0 that the ratio 
\/\i — c I vanishes like some positive power of | j- — c |, 
then it is po.ssible to relax the uniform requirement in / and to 
permit a growth factor. In fact, we have the rather interesting 
result, Tlieorem 3. 


Thkohem 3 

Let/“’(^(0) for I < 5 with 5 > 0, satisfy the ineriuality 


PI 


< m(^‘ 1 i I 



for certain positive constants m and a and all I > 0. Let .4(0 
be either a constant or periodic matrix, and let the principal 
matrix solution T(0 of the linear system 


= (Ul) 

satisfy | Y{t) | < 

for suitable positive constants c, and ai. That is, let .1(0 be 
either a constant or periodic matrix for which the trivial solution 
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of (19) is asymptotically stable. Then ii a < ai, the nonlinear 
system 

+ ( 20 ) 

is asymptotically stable at the origin. 

Proof: We consider only the case where A(t) is a constant 
matrix. The proof for the periodic case is similar. From (44) 
of Chap. 4, we have for any solution of (20), 

5(0 = Y(t) c Y(t — s)/‘*K^(s), s) ds 
where c is initial vector. Hence 

I x(0 I < Cl I c I c-“'‘ + Cl |/”>(i(s), s) I ds 

or, what is the .same, 

I m I e“'- < c, I c I + c. (s), s) I c-- ds 

So long as the solution x(/) satisfies |x(0 | < 5, we have further, 
using (18), 

(|x(0|c“‘') <ci|c| + cim /Q'|x(s)|c“*[|^(s)|c“"]ds (21) 

If we require that | c | < 61 ci, so that (21) is valid over some posi¬ 
tive interval of time, then using Gronwall’s lemma, (21) yields 

I x(/) I e“'' < Cl I c I exp ^cm \ x(5) | e*" ds j 
or, what is the same, 

‘*'(0 < I c I exp ^ci®m $( 5 ) ds — (ai — a)i j (22) 

where 4>(0 = I m I €“‘( 01 . Let us further require that |c| < 
(ai — a)/mci so that 4»(0 < (ai — a)/mci^ on some interval 
0 < I < b, b > 0. Then (22), in turn, yields 

1^1 < 4.(0 < I c- 1 
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since the exponent is initially negative. Thus, the two restric- 
tions|t'| < Vciand|e| < (ai - imply tliut tiic inequali¬ 

ties |i(0 I < 5 and < |c| liold throughout and. because of 
the latter, that lim |x(0 | = 0. 


Example 7 


Consider the nonlinear scalar equation dx/dt -|- 2x - = q. 

The linear equation dx,'dl -|- 2j = 0 is asymptotically stable at 
the origin and Y = e-‘‘ is its principal "matrix” .solution. Thus 


since \c'x^ 


X = X 


c', the nonlinear system Is also asymptoticallv 


stable at the origin. Indeed, we can solve it explicitly. Tor 
upon multiplying by the integrating factor c-', we obtain 


d(xc=0 

dt 



which is separable. Thus for any nontrivial solution, 

1 

•*' ” (l/jTo- l)c-' + e' 

where zo is the initial value of x for / = 0. Clearly, if xo < +1, 
lim X = 0 so that indeed the origin is asymptotically stable. If 

1 < Xo, the corresponding solution exists only for a finite interval 
of time. 


EXERCISES 


1. Prove Theorem 2. 

2. Prove Tlieorem 3 when the linear approximation is periodic. 

3. State and prove a result similar to that in Theorem 3 for a 
system (20) satisfying the nonlinearity condition 


ii\ 


< me®' IX f 


with m, a, and certain positive constants. 



142 NONLINEAR DIFFERENTIAL EQUATIONS 


4. Explain why the trivial solution of the nonlinear equation 
d^xfdt- + k dx/di — t^'{dx/dty + x = 0 is asymptotically stable 
for any positive number N provided the constant k is positive. 

5. Explain why the trivial solution of the nonlinear equation 

d^x/dt^ + k dx/dl + (x — = 0 is asymptotically stable for 

any positive number AT provided the constant k is positive. 

6. Discuss the particular significance of Theorem 3 for systems 
which are analytic (or sufficiently differentiable) in x. 

7. Rephrase Theorem 1 for nonautonomous systems satisfying 
(17). 

8. Using the result in Exercise 7, introduce a suitable artifice 
to show that the nonlinear system dx/dl = A(0) x +/^‘K/3,x,0, 
where /3 is a vector parameter, is asymptotically stable at the 
origin if the linear approximation dx/dt = Ai^ x is. Introduce 
suitable restrictions on the perturbational term J^'^{0,x,t) and 
the coefiicient matrix .4(^). The nonlinear system is then said 
to po.‘<sess structural stability near the origin. 

9. Under what circumstances does the nonlinear equation 
d‘x/dt- + k dx/dl + u-x = 0f(x,dx/dt) possess structural stabil¬ 
ity near the origin? 


We conclude this section by considering a theorem which 
essentially generalizes to nonlinear systems a result obtained 
already in Chap. 4 for linear systems. We consider a nonlinear 
system in which the nonlinear part is impulsively small relative 
to the linear part. 

Theorem 4 

Suppose 5 and c arc positive constants such that 

jo \xis)\ 

for every continuous functions x(s) satisfying | x{s) | < 5. Then 
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if the linear system 

'^=.l(/).f (■->:!) 

where /i(0 is either a eonstant or periodic matrix, is stable at the 
origin, then the nonlinear system 

= A(t) X + (LM) 


is stable at the origin. 

Piioof: Again we consider only the constant matrix case. The 
hypotheses imply that the principal matrix solution }’(0 of (23) 
is hounded as / —» ac. Thus, using (4-1) of Chap. 4, we have, for 
any solution of (24) 

I m I < <■, I f 1 + <■. '-^"i jw i 

for suilalde cj, wliere c is the initial vector of x. Iflr|< 6, then 
|.r(.s) I < b will hold on some interval 0 < 6* < h, 6 > 0. I’sing 
(ironwall’s lemma, (2.")) yields 


\Ht) I < c,|c|exp 


N)| 

‘' I m I 


(ii 




Thus, if c further satisties | c | < then the ineciuality 

•i(t) I < 5 "ill hold for ad i > 0 and the theorem is proved. 

Tliis theorem generalizes one of the linear cases considered in 
Chap. 4, namely,/*'’(i,0 = B{1) i‘, with B{t) impulsively small as 

i—f CO, 


Example 8 


Consider the nonlinear equation 



where /(/) is continuous. Since the linear approximation 
dh'/dl^ + = 0 is stable at the origin and for any continuous 
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functions xi(0 and Xi{t) satisfying, say, |xil + \xi\ < 1 for all t, 
we have 


/'* Mt)\ i/(xi(o)i dt . r- \f(xi 

Jo |a;i(OI + 1 ^ 2(01 1 + ” Jo ^ 


m 
+ 


'-'dt 




dt 






where M = max |/(x)|, it follows from Theorem 4 that the 
nonlinear equation is stable at the origin. 


4. Stability of Singular Sohitions of Implicit Equations 


The technique used in the preceding sections may be applied 
to an implicit equation of the form 


dx ,. , 

Ti = + 

if J{x,y) satisfies the condition 




(26) 


Hm = 0 


(27) 


We limit the discussion to autonomous systems merely for con¬ 
venience of expression. The condition (27) implies that the 
derivative in (26) is “nearly explicit,” at least near x = 0 and 
dx/dt = 0. To identify those solutions of (26) of which we shall 
speak, we assume that x = 0, y = 0 is a solution of the algebraic 
equation 

y = /lx + J{x,y) (28) 

and that (28) defines y as a single-valued Lipschitzian function 
of X in a neighborhood of x = 0. We have then. Theorem 5. 


Theorem 5 

If the linear system 

— = 

dt 


( 29 ) 
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is asymptotically stable at the origin, and if J{x.y) satisfies the 
nonlinearity condition (27), then (26) is asymptotically stable at 
the origin. 

Proof: Again using (44) of Chap. 4, we have for any solution 

of (26), 

m = Y(t) c + j' Y(t - s) ;(x(s), y(s)) ds (30) 


where F(0 is the principal matrix solution associated with (20), 
y = dxldt. and c is an initial vector. The hypotheses imply that 

I Y(t) I < 

for suitable positive constants Ci and a. Hence (30) yields 

1 m I < C, I + c, ' I m I <1^ (31) 

On the other hand, from (26), we obtain 


|?/| < |A|UI + lMy)| < C2|a-| + l/(x,y) I 


= iu( 


c, + I' 


for a suitable positive constant C 2 . Thus 

F! < c, + I 


lU 


lU 


and since 


Vix,y)\ _ ifix,y) I A .i^r 

|x| m + |y|l ^|i| 


it follows that 


U(^y) \ ^ _L/(£iy) I 

|x| -|x|+|y| 


1 + c, + 1 


Prom this, in turn, we obtain the inequality 

/(x.y)|<, , r_I_ 

|x| ' + -|M^)l/'(|x| + |i/|) 

provided \J{x,y) 1/(| x | + | y |) < 1. 


(32) 


( 33 ) 
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Now let € (0 < e < 1) satisfy the inequality 

Ci(l + C2) ^ ^ ■ < a 

and let 6 > 0 be chosen, according to (27), so that 

I ^ . 

\i\ + \y\ 


( 34 ) 


(35) 


whenever | ^ | + | y | < 5. If | c | is sufficiently small, then the 
inequality | x{t) | + | y{t) \ = | x'{t) \ + | (iJ'/dt \ < 5 will be satis¬ 
fied on some interval 0 < f < 6, with 6 > 0. Then (31), (33), 
and (35) together yield 

[| ^(0 I < Cl I c I -H ci(l + cj) II •?(«) I c***! ds 

By Gronwall’s lemma we obtain further 

I i(0 I e®‘ < ci| c|exp |^ci(l + C2) ^ ^ t 
or, what is the same, 

I i'(0 I < Ci| c| exp j^ci(l -h Cj) ^ ^ — aj I (30) 

On the other hand, from (32) and (35) we have 

I yiO I < I ^(0 I (ca + c) 

which, together with (30), yields 

-f(0 I + I ij(t} I < c,| ("I (1 + f2 + e) 

exp j^ci(l 4- C2) j—^ “ «j * (37) 

According to (34), the factor |^ci(l + C2) ^-a j in the 

exponent of (37) is negative. Thus if c satisfies the inequality 


|c| < 


Cl(l + C2 -1- «) 
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(37) will remain valid for aiW > 0 and certainly 

lim i| m I +1 m li = 0 


Example 9 


Consider the ecjiiation 


r 

(I + x) 



The linear approximation d-x/dl- -|- d.r,-dl .r = 0 is asymp¬ 
totically stable at the origin, and the nonlinear portion satisfies 


x\ \dh-; dr- 


X 


i-^i I" •'/>“ I_I I 

4- 2\dx/dt\ -b \d\r/dt-\ - ‘ ' 


Thus according to Theorem o, the nonlinear ecpiation is also 
asymptotically stable at the origin. One obtains the same result 
upon division by 1 -j- a: using Theorem I. In fact from 



wc arc led to consider 


d'X 

dl- 





1 + x/ dt 


( 



1 +x 


) 



The jionlinear portion satisfies 


(UI/11 + x\){\dx/dt\ -b |xl) _ 1 j| ^ ^ 1 ^ 

Ui -b \dx/dl\ 


for Ui < 1 2 


which is the appropriate nonlinearity condition for this case. 


Example 10 

Consider the equation 

(SO + ! + " = « (38) 


Real solutions exist only for sufficiently small values of \dx/dt + 
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x\ since |sin {d^x/dt^)\ <1. For convenience let us restrict 
d^xfdf^ to the range —ff/2 < dHJdi^ < flr/2. Then (38) pos¬ 
sesses a unique solution through each initial point near the origin 
and is equivalent to the explicit equation 

^ - arcsin (x + (39) 


where arcsin is the principal branch of the inverse sine function. 
Equation (38) may also be written in the form 


Now 


d-x , dx , , 

rfF + dr + ^ + 




Isin (d'-x/dt^) - d^x/de] ^ Isin {d^z/dP) - d' ‘x/dP\ 

|x| + 2\dx/di\ + \d^z/dP\ - \d^x/dP\ 

sin {d^x/dt^) , 

“ d^x/dt^ 


and from the well-known limit of sin $/9 for d —» 0, we conclude 
that the nonlinear portion of (38) near the origin satisfies the 
nonlinearity condition. Thus, since the linear approximation 
dHjdV- + dxidl -H x = 0 is asymptotically stable at the origin, 
the same is true of (38). 


EXERCISES 

1. Prove Theorem 4 when the linear approximation is a peri¬ 
odic system. 

2. Discuss, in detail, the application of Theorem 5 made in 
Examples 9 and 10. In particular, explain the origin of the non¬ 
linearity condition in each case. 

3. Using Theorem 1, show that the trivial solution of (39) is 
asymptotically stable, 

4. Replace the nonlinearity condition (27) with the strong 
inequality 

^ -0 - 1+1 I ) 
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where m is a positive constant, and use this to prove Theorem 5. 

5. Discuss the particular significance of the result in Exorcise 4 
for analytic (or sufficiently differentiable) systems. 

5. Stability of Nonsingular Solutions 

The stability characteristics of a nonsingular trajectory i{t) 
of the equation 

/1r 

= Jm (-40) 

arc reflected in the stability characteristics of a singular solution 
of a related equation. In fact, if x*it) is a neighboring solution, 
then the perturbation function y{l) — x{t) — x*{i) satisfies the 
equation 

= hm, t) - jm - g(t), i) = /•(s(o, o (4i) 

where the right-hand member vanishes identically for y{l) = 0. 
Thus x(l) is a stable solution of (40) if and only if the trivial solu¬ 
tion of (41) is stable. Equation (41) is called the perturbadon 
equation. Typically, one attempts to infer the stability char¬ 
acteristics not from the perturbation equation but from the 
equation of first variation. The latter is the unique linear part of 
(41) near the origin, assuming that /(j,0 is continuously differ¬ 
entiable in X. We denote by }j{x,t) the Jacobian matrix 

dfi Bf, dfA 

— — - - • « « 

dxi dx2 dXn 

dfz 0/2 d/j 

dxi dx2 dXn (42) 

dU dU _ ^ 

dXi dX2 dXn 

where /i, ft ./« are the components of J{x,t), and the linear 
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part of (41) is 

^ = um, 0 m) ( 43 ) 

The perturbation equation (41) may then be expressed in the 
form 

f = hm), 0 m) + o (44) 

and the theorem of the mean guarantees that(5,0 satisfies the 
nonlinearity condition. Of course, the stability theory for even 
the linear (first variation) equation (43) is manifestly incomplete 
except when /i(x(0, 0 is either constant or periodic, or approxi¬ 
mately constant or periodic. Still, these cases arise sufficiently 
often to justifj' the emphasis placed upon them in Chap. 4. 

An important case arises when x(0 is a periodic solution, for 
when it is stable, it represents steady-state phenomena. For 
example, a periodic solution x(0 may be the steady-state response 
to a periodic input in (40). In this case, the equation of first 
variation (43) becomes 

I = P(t) y (45) 

where Fit) = /i(.f(/), 0 is a periodic matrix. If the origin of (45) 
is asymptotically stable, then the steadi'-state response x(/) is 
asymptotically stable. 

Another case, frequently encountered, occurs when (40) is 
autonomous, i.e., 

§ = m ( 40 ) 

and x{l) is a periodic (self-sustained) solution of (46). It may be 
that (46) is conservative and exhibits only periodic solutions. 
In any event, with x(0 periodic, the equation of first variation 
(43) is again periodic with the period of x{t). In this case, how¬ 
ever, the equation of first variation is nci'er asymptotically stable 
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at the origin. For upon differentiating (40) with respect to I, 
we obtain 

(l{dx/dt) _ 

and this shows that dx/dt is a solution of the equation of lirst 
variation. In particular, since x(0 is periodic, dx^dt is periodic 
with the period of x(t), and so the equation of first variation 
possesses a periodic .solution with tlie period of the system. 
Therefore, the equation of finst variation can l)e at best stable 
at the origin. It can be shown,’ however, that if the equation of 
first variation pos.se.s.ses just one characteri.'Jtic exponent with 
zero real part (corre.sponding to the known perhjdic solution 
dx/dl) and each of the remaining characteristic numbers lia.s a 
negative real part, then j(0 po.^ses.ses a.symptotic urbilal stability. 
In fact, each solution /*(/) near tlie periodic one possesses an 
asymptotic phase; i.e., tliere is a y sucli that 

lim p(/) - i*(( + 7 )| = 0 
* * 


Example 11 

Consider the forced Ouffing equation 

(i 

^ + 0x^ = ^/u cos wt (47) 

where each of k, /3,/u, and w is a constant. The vector equivalent 
of (47) is 

I = 

with = J 

‘ E. A. Codclington and N. Levinson, ''Theory of Ordinary DifTereiitial 
Equations,” pp. ;i2!t-;t27, McGraw-Hill Hook Company, Inc., New ^’ork, 
lt<56. 
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The equation of first variation is 


where 


f = ^(*(0, m 



0 

-1 - 




The scalar equivalent of (48) is 

0 + fc ^ + [1 + mmv = 0 (49) 

where x{t) is a scalar solution of (47). In particular, if x(t) is a 
periodic solution of (47) and if > 0, then Theorem 6 of Chap. 4 
guarantees that the trivial solution of (49) is asj^mptotically 
stable, provided l/Sj is sufficiently small. Because the equation 
of first variation is asymptotically stable at the origin, the cor¬ 
responding periodic solution of (47) is asymptotically stable for 
I/3| small. 


Example 12. Poincar6 Criterion for Orbital Stability 
Consider the two-dimensional autonomous system 



= p{Xx,Xi) 


dxi 

It 




(50) 


where p(xi,X 2 ) and ^(xi.xj) are continuously differentiable in each 
variable. Suppose that this system possesses a nontrivial peri¬ 
odic solution [xi(0, X2(0) of period r > 0. The equations of first 
variation arc 


^ = Pi(xi(0, X2(<))yi + p!(xi(0, .r2(0)//2 
^ = 5i(xi(0, X2(0)!/i + 92 (xi(0, X2(0)!/j 



where we use the notation pi = dp/dxi, P 2 = dp/dx 2 , q\ = dq/dx\y 
and ^2 = dq/dXi. This is a linear periodic system of period t, and 
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therefore its principal matrix solution may be expressed in the 
form 

no = QiO (52) 

where Q(0 is a 2 -b 5'-2 periodic matrix of period t, and 5 is a 
2-by-2 constant matrix. The determinant of T{0 satisfies 

1^(01 = IQ(0l lc«i = exp [/^' trace P(s) rfs] (53) 

where P{0 is the 2-by-2 matrix of eooffieients in (51). On the 
other hand, we have for the determinant of 

|e®'| = exp (trace BO (54) 

From (52) it is clear that 0(0) = I (the identity matrix), and 
hence Q(t) = I. Thus (53) and (54) together yield, for ( = t 

1 

trace B = ~ trace P(s) ds 
T Jo 

[pj(ii(«), xj(s)) + 92 (j:i(s), X 2 (s))] ds (55) 

In general, the trace of a constant matrix is equal to the sum of 
its characteristic numbers, and so (55) may be expressed in the 
form 

Xi + Xj = - / [pi(xi(s), X 2 (s)) + ( 72 (xi(s), Js(s))] rfs (56) 
r Jo 

where X; and Xo are the characteristic numbers of B. Now the 
periodic system (51) is known to possess a periodic solution of 
period t, namely, [dxi/dt, dxj/dt], and this is possible only if zero 
is a characteristic number of B. Thus, (56) may be further 
expressed as 

X = - / Ipi(^i(s), a:s(«)) + 52 (xi( 5 ), X2(5))I ds (57) 

where X is the one possibly nonzero characteristic number. In 
some cases both characteristic numbers are zero. However, if 
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X < 0, then the periodic solution of (51) is asymptotically stable. 
In fact, there exists a base for solutions of the linear system (51) 
consisting of the periodic solution {dx\/dt, dxz/dt) and a second 
solution of the form [j/i(0 = a{t) e^', yz{t) = b{t) e^*] with each 
of a{t) and b{t) periodic of period t. Thus, if X < 0, every solu¬ 
tion tends exponentially to a multiple of the periodic one as 
t—*°o. Clearlj% the variational system is stable at the origin 
but is not asymptotically stable at the origin. Thus, the stabil¬ 
ity of the (original) periodic solution [xi(0, J^ 2(01 of the nonlinear 
system (50) remains in question. 

To investigate this question further, let us depict perturbations 
in (50) in terms of perturbations in initial values. Specifically, 
let the initial values of the periodic solution (Ji(0> ^ 2 ( 0 ] he Ci and 
C 2 , and let the initial values of a neighboring solution be ci + 5i 
and Ci -b 5-:. (It is not difficult to show that as the pair (5i,52) 
varies in some neighborhood of (0,0), all neighboring solutions 
sufficiently close to the periodic one are represented.) The 
neighboring solution is then given approximately by (xi(0 -|- y\{i), 
•r 2(0 + ^ 2 ( 01 . where [j/i(/), !/ 2(01 is the solution of the variational 
ecpiations (51) satisfying the initial conditions 7/i(0) = 5i and 
.72(0) = 5i. If these initial conditions can be met with the 
exponentially decaying portion of the general solution of (51) 
alone, then it would appear that the approximate solution 
[j'i(0 + y:{t), x-iit) + 72 ( 0 ] of (50) tends to the periodic one 
exponentially. However, (wo initial conditions cannot in general 
bo met with a one-parameter solution. Therefore, we introduce 
another degree of freedom by way of the following artifice. 

For any constant 7, the pair [xi(i -f- 7), X2{t 7)] is once again 
the periodic solution of (50), parameterized in a somewhat differ¬ 
ent fa.'^hion. Hence, a neighboring solution is given approxi¬ 
mately by (xi(/ + 7) + 7i(0. ^ 2 (( + 7) + 72 ( 0 ] as before, except 
that now the neighboring initial values become ^ 1 ( 7 ) + 7 i( 0 ) and 
3 ' 2 ( 7 ) + 72 ( 0 ) in place of Ci -f- 7 i( 0 ) and C 2 + 72 ( 0 ). We dupli¬ 
cate the given initial values Ci -}- 5i and d Sj for the neighbor- 
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ing solution by requiring yi( 0 ) = ri + 5| - Xi(y) = if and 
^ 2 ( 0 ) = C 2 + ^2 — ^ 2 ( 7 ) = 5*- I‘or 7 = 0 . these are as l>efore. 
but now wc may vary 7 which, in turn, induces variations in the 
initial values 6* and b* of ijiH) and //..(/), respectively. To be 
sure, the variations are not arl)itrary since J i( 7 ) and -r 2 ( 7 ) are 
given functions. Nonetheless, the variations are suflicient to 
ensure that only the exponentially decaying portion of the 
general solution of (51) is required. 

To see this, we note that permissible initial values 6 f and 5.f 
form a one-parameter family 6f5(0) = 5.fn(0), since tlnw must 
be in proportion to tlie initial values of the exponentially decaying 
solution (//i(/) = (i (0 c^', = hil) c^'j. Hence we must be 

able to choose 5f (say) and 7 so tliat 


ri(7) + Sf = 5. + r, 

2-2(7) + 5 f = -h c-i 


(58) 


with each of Cx, Cj, 5|, and 5-.. given. The circumstance ( 7 ( 0 ) = 0 
is not covered here but requires only an obvious modification. 
Clearly, for 7 = 0 and 6 f = 0, (58) yields 5i = 0 and 5. = 0. 
Hence, if the Jacobian 


f ’ 

dy 

dx2 6 ( 0 ) 

dy a( 0 ) 


6(0) (/.fi (Ixt 
a( 0 ) (}y dy 



does not vanish for 7 = 0, (58) will pos.<ess a (unique) solution 
( 7 ,if) for each pair ( 6 i, 6 -d with |5,| and li..| .sufliciently small. 
In the event./ = Oat the initial point, we merely move to another 
for which the right-hand member in (59) is not zero. That 
there exists such a point is clear since the ratio 

dxj/dy _ dxi 
dxifdy dx\ 

which is the slope of the tangent to the trajectory, cannot be 
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constant along a periodic solution. Finally, we note that the 
illusive T sought here is an asymptotic phase for the neighboring 
solution. 


Example 13 


Consider the Rayleigh equation 

d^x \dx l/da:Y1 




It is well known that for m > 0, (60) possesses a unique periodic 
solution which for/i small is given approximately by x(0 = 2cos^ 
The equations of first variation are 



yt 

-y\ + 



( 61 ) 

2/2 


Using (57), we have 



or, approximately, 

X = ^ y (1—4 sin^ t) di = —fi 


for the one nonzero characteristic exponent of (Gl). Thus, it 
appears that the periodic solution of (60) possesses asj'mptotic 
orbital stability, at least for small /x. Actually, it does so for all 
a > 0. 


EXERCISES 

1. Explain why it is that the nonlinear term in (44) satisfies 
the nonlinearity condition. 

2. Construct a variety of examples to illustrate the concepts of 
perturbation equation, equation of first variation, and orbital 
stability as discussed in this section. 
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3. Discuss Example 12, supplying complete details for each 
of the several conclusions. Note in particular those conclusions 
which might be of general interest, and illustrate each. Supply 
figures to illustrate those steps which are essentially of a geometric 
nature. 

4. Explain why there exists a nonsingular matrix T such that 


= = 1 ) 

where B is the matrix in the exponent in (52). 

5. Using the nonsingular matrix T of Exerci.se 4. introduce a 
linear transformation in (51), and show that the corresponding 
principal matrix solution y*{t) in the new coordinates is of the 
form 

where Q*(0 is a 2-by-2 periodic matrix of period t. Explain why 
“permis.sible” initial values for the linear variations in the new 
coordinates correspond to the circumstance = 0, 6* 0. 

0. Introduce the linear transformation of Exercise 5 through¬ 
out in Example 12, and rederive the main results. Note the 
relatively simple forms for (58) and (59). What is the geomet¬ 
rical meaning of the condition 0 in the new coordinates? 

7. Using the results (and the notation) introduced in the above 
exercises, prove that the periodic solution of (50) i.s asymptot¬ 
ically orbitally stable if the characteristic number X given in (57) 
is negative. In fact, explain why, in the new coordinates, the 
exact perturbation vector y .satisfies an integral equation of the 
form 

Ht) = Q*{t) + j‘ Q*(t) Q Q*->(.) }iy{s)) ds 


(i) 
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where J{y) satisfies the nonlinearity condition 


lim 
I'-f -0 


I /(g) I _ 0 

|g| ~ 



Note that the first term on the right in (i) is the linear perturba¬ 
tion y*, i.e., the corresponding solution of the equation of first 
variation, and that the integral equation (i) may be expressed 
in the form 


9(1) = g*(/) + Q*(t) (U <?*”(«) /(g(®)) 

+ I"'?*(') (‘ °) Q*-'(s)/(g(s)) ds (iii) 

It will be found that the solution y(t) satisfies an inequality of 
the form |i/{0| < Anticipating this, show that the 

second term on the right in (iii) necessarilj' tends to zero (the 
zero vector) as t—* «, provided 15*1 is sufficiently small. First 
explain wliy |/(,y(-‘')) 1 < 15*1AV''=, provided |5?1 is sufficiently 
small, and then proceed with the second term on the right in 
(iii). Now explain why the third term on the right in (iii) must 
also tend to zero (the zero vector) as i —» oo and, therefore, why 
(iii) may lx* reformulated (for jjresent purposes) in the form 

g(0 = !7*(t) + £ (rH) (jj 0*-'(s) /(g(s)) ds 

- j' Q\l) ^ fr-‘(s) J(y(s)) ds (iv) 

A solution of (iv) may be obtained by the method of successive 
approximations provided the initial vector is sufficiently small. 
Let = U*{0 be the first estimate and 

ru) = g*(o + [ Q‘(t) (o <?*-'(«) /(g''’(s)) ds 

- f‘ Q*(t) Q o) 0’-'(5) /(g'‘'(5)) ds (v) 
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be the second. Note that 

I!/"’(() I = c|«.*|c'' < < cl«?l 

for a suitable positive constant c. Let e be a positive number 
and explain why there is a positive number 6 such that 

l/(tf) I < «|i/| forli/l < 5 

Use this to derive from (v) the inequalities 

fjg _|_ (Is 

4(|5?|c.c , 

- IM 

and + ''ix'j') 

for a suitable positive constant Ct and for jS,*! < 5/c. Then show 
that if 

s<«(0 = ?/•(() + Q\I) (o (?*-'(.«) /(;/'='(»)) rf,s 

- I <2*(0 (o IJ) /(;/'='(»)) rfs 

is the third estimate, one may derive the inequalities 

I S''>(0 - »''’(01 < (l + 

and I I < n|«?| ^1 + j 

Derive analogous inequalities for each of the successive approxi¬ 
mations and show that for e sutficiently small and for a suitable 

positive constant/f, I I < for all fc = 1 , 2 , ... . 

Finally, let p be a positive number and explain why J{y) satisfies 
the Lipschitz condition |/(t/) -/(x) | < p\ij - x[ in a sulH- 
ciently small neighborhood of the origin, and show that for [ 62 *! 


|r>(0 - S<”W| < I' 
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sufficiently small, the successive approximations satisfy the 
inequalities 

(y(t+i)(/) _ I < pc, I i/s 

+ pCi I i/s = pCi Ns 

for = 2, 3. Now complete the argument. 


6. Direct Stability Method 


The methods of the preceding sections typically fail to indicate 
stability in the absence of asymptotic .stabilit 3 \ This is because 
the theory is developed around comparison Ihcorcms, the applica¬ 
tion of which requires that the linear part of a system be respon¬ 
sible for the stability. Often, this i.s simplj' not the case. 

A second method of Liapunov treats the stability problem 
directly and in a natural, though somewhat nonconstructive, 
way. Application of the second method is not limited by an 
artificial circumstance as is the first (comparij^on) method. 
Rather, the second method is limited by practical matters 
relating to the construction or discovery of suitable testing 
functions. Generally speaking, for the direct method one seeks 
.something resembling a potential function which has a minimum 
at a given singular (ccpiilibrium) point, say, the origin. The 
idea is more or less that if one is able to find a suitable continuous 


scalar function r(I) which is positive for x 7 ^ 0 and zero for 
X = 0, then along a trajectory x(/) an inequality of the form 
^ 5 will guarantee a related inequality |i(0 | < e with 
«—> 0 as 5-^0. The quantity r(i-) is then a measure of the 
smallness of x. More precisely, we define the scalar function 
F(j) to be a Liapunov function for the sj'stem 
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if for X in some neighborhood of the origin, r(x) is positive for 
X 5^ 0, zero for x = 0, has continuous first derivatives in each 
variable, and satisfies 

vr{x)/(x) < 0 (03) 


\5xi 5x2 


• • • 


-Y Thi 
>.vj 


his last inequality guarantees that the 


where rF(x) is the gradient of V{x) expressed as a row vector 

£1 

2 5x, 

quantity r(x(0) is nonincreasing along each trajectory x{0 
sufficiently near the origin. In fact, the total t derivative is 
precisely 

^ |r(i(0)) = vre(i))^ = vc(x(())/U(()) 


and, therefore, nonpositive. We have the elementary but funda¬ 
mental Theorem 0. 


Theorem 0 

If there exists a Liapunov function r(x) for (02), then (02) is 
stable at the origin. 

Proof: Lot e be a positive number such that (03) and the other 
hypotheses concerning l'(x) hold for | x | < «. Since ]’(x) > 0 
on the surface |x| = c and the surface is compact, i.e., closed 
and bounded, P(x) is bounded away from zero on |x| = <. 
Suppose V{x) > Tj > 0 for IX I = e. Then there exists a 5 > 0 
such that, say P(x) < t?/ 2 for |x| < 5. Surely 6 < e. If a 
trajectory x{l) of (02) satisfies x(0) = c with |c| < 5, then since 
V is nonincreasing along the trajectory x(/), we have 

vdio) < c(o-) < I 

so long as | x(0 | < <. But x(/) cannot then penetrate the surface 
|x I = e on which we have r(x) > tj. Hence, |x(0 | < c for all 
t > 0, which proves the theorem. 
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Example 14 

Consider the second-order equation 

, kdx , - _ 

dP-+ nf +^ 

and the related vector quantities 

Let r(x) = X 2 ^ for which, certainly, y(x) > 0 for x 0 

and 1 (0) = 0. Also from the above we have 

VTXx);(x) = (2a,*ri, 2X2) ( ^ = -2A-X2= 

\—w^xi — kxi/ 

Thus if k > 0, y(x) is a Liapunov function and the system is 
stable at the origin. More generally, if /(x,y) > 0 near the 
origin, then the nonlinear equation 

is stable at the origin. V = to^x® + (dx/dt)^ is a Liapunov 
function for this nonlinear equation. 

Example 15. Lagrange’s Theorem on the Stability of 
Equilibrium 

Let // = AT + V be the Hamiltonian of a system with n 
degrees of freedom. Let ^i, ..ffn be n generalized coordi¬ 

nates, and pi, p3, . . . , p„ tlie corresponding n generalized 
momenta. The n equations of motion 

_ dV 

dt \dpi/ dqi dQi « - 1, 2, . . . , n (64) 
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together with n notational equations 


dt 






form a 2«th-ordcr s^'stem as dehned here. As is well known. 
(64) and (65) merely express the fact that the total t derivative 
of the Hamiltonian H along each trajectory vanLshes, i.e., 

dH{x{t), dx/dt) d 

- Jl - ^ dt ^2. • • • » V'M Ph P:. . . . , pJ = 0 


Now the potential energy V depends solely upon the q, and. typ¬ 
ically, is analytic in the q„ vanishes, say, at the origin and 
possesses a local minimum there. The kinetic energy I\, typ¬ 
ically, is a positive definite (piadratic form in the p. (i.e., vanish¬ 
ing only for = 0, t = I, 2, . . . , n, and positive otlierwise) 
with coefficients analytic in the 7 .. Clearly, then, the Hamil¬ 
tonian // is a Liapunov function for llie system (64), (65) and 
the origin (static equilibrium position 7 i = q> = • • • = 7 ^ = 6 ) 
is stable. 

♦ ♦♦♦♦♦ 4 

The Liapunov function may be useful for other than mere 
stability considerations. For example, it is clear that 

lim F(x( 0 ) = Fo > 0 


exists for each trajectory, passing sufficiently close to the origin 
at some time. If, in addition, x{t) is a nontrivial periodic solu¬ 
tion, then F(f(()) = Fo, a constant greater than zero. The latter 
property is sometimes useful in locating periodic solutions or, as 
the case may be, in demonstrating the impossibility of periodic 
solutions. In Example 14, the only possible loci for periodic 
solutions are subsets of the ellipses 


F(i) = + 




But these, obviously, do not contain solutions unless A: = 0. 
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Geometrically we interpret the locus r(x) = constant as a 
surface enclosing the origin. It possesses the property that if 
any trajectory penetrates the surface, it does so from the outside 
to the inside. Of course, trajectories may also lie on the surface. 
We have seen that periodic solutions necessarily lie on such 
surfaces. More generally, the positive limit cycle of any solution 
x(0 (which passes sufficiently close to the origin at some time) 
must lie on a surface r(i) = constant. On the other hand, if the 
total t derivative dV{x{l))/dt is (and remains) actually negative, 
then the trajectory x{t) must actually penetrate each of the level 
surfaces (F = constant) of V which it encounters. Thus we 
have Theorem 7. 


Theorem 7 

If there exists a Liapunov function F(x) for (62) so that in 
some neighborhood of the origin 

vr(.f)/(.f) < 0 (66) 

for X 9^ 0, then (62) is a.symptotically stable at the origin. 


Example 16 

Consider Lidnard’s equation 


and the equivalent system 


S - . - rw 

f - 



where F{x) = f(u) du. We assume that/(a:) is a continuous 

function and g{x) is a Lipschitz function, vanishing for x = 0. 
The Cauchy-Lipschitz existence-uniqueness theorems then apply 
to (67), and hence to (68). We note that the xy plane of (68) 
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is not the usual phase plane associated with (G7). The x\j plane 
of (68) is referred to as the Licnard plane. If the inequalities 


tr>9) 


ff(x) F{x) > 0 
G{x) > 0 

where G(x) = ^(w) du, hold in some neighborhood of x = 0. 

then 

= Viy- + G{x) (70) 


is a Liapunov function for (68). In fact 

vr(x,7/)/(x) = (ff(x), y) ^ -gU)F{x) 

Clearly, if in some neighborhood of x = 0 

g{x) h\x) >0 (71) 

for X 9^ 0, then (68) is asymptotically stable at the origin. 
Notice that the second inequality in (09) is guaranteed by the 
inequality x^(x) > 0 in some neighborhood of x = 0, i.e., if //(x) 
assumes the sign of x for |x| sufliciently small. In such a case, 
the first inequality in (69) is guaranteed by a similar condition 
on the sign of /(x) for |x| sufliciently small. Finally then, the 
inequality (71) is guaranteed by the two inequalities (largely 
fulfilled in applications) 

x/(x) > 0 

( 7 - 7 ) 

xf?(x) > 0 

for X 0 in a neighborhood of x = 0. 

4 ♦ ♦ ♦ ♦ ♦ ♦ 

For instability we have Theorem 8. 


Theohem 8 

If in a neighborhood of the origin a scalar function TF(x) is 
continuously difTercntiable, satisfies 


VlF(x)/(x) > 0 


(73) 
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for X 9^ 0, and vanishes at the origin but is positive at some point 
of each neighborhood of the origin, then (62) is unstable at the 
origin. 

Proof: Let 5 be a positiv^e number such that the hypotheses 
apply for | .f | < 6. Let M be the maximum of Tr(x) for | x | < 5. 
Consider any positive number e < 6. There exists a point c, 
satisfying |c| < e, such that T7(c) > 0. Since = 0, there 

exists a positive number rj such that Tr(^) < lP(c) for |.f | < t;. 
Clearly, ?? < | c | < € < 6. Let m be the minimum of Vir(x) J{x) 
for 7j < I X I < 5. By (73), it is clear that m > 0. If x(t) is the 
trajectory with c as initial value for t = 0, then d]V(x(t))/dt > 0, 
so long as | i-(0 | < 6. Hence ir(x(0) > IPfc), and necessarily, 

I j'(0 I > rj- Thus 


. — = ^11 (■r(0)/(x(0) > m 


so long as 


I m I < s. 


But this in turn implies that 


l!’{.r(0) > ir(c) + hn 


and .^o cither ir(i*(/)) must eventually exceed M or j x(f) | 
eventually exceed 5. The latter is assured in either ca.'ie since 
M is the maximum of If'(x) for | x | < 5. Thus from within 
each neighborhood of the origin stems a trajectory which pene¬ 
trates the surface |x| = 5. Tlie origin is manifestly unstable. 


I-XHIKISKS 

1. Discuss the geometric meaning of (03). Con.sider the gra¬ 
dient VI as a vector normal to a level surface of V and /(.c) as a 
direction field. What is a familiar name for the product in (03)? 

2. Prove 'J'heorem 7. 

3. Explain wiiy the .second-order ecpiation (07) is equivalent 
to the system (tiS), and construct a number of examples of 
Lienard's eejuation (67) which satisfy the inequalities (72). 

4. Construct a number of examples illustrating Theorem 8. 
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5. State and prove theorems analogous to Theorems (». 7. and 
8 for nonautonomous systems. 

6. Show that if V(x) is a Liapunov funetion for then the 
po.sitive limit cycle of a solution passing sufficiently close to the 
origin lies on a surface r(i) = constant. 

7. Consider the two-dimensional svstem 

% 


dx 


P(x,y) 




Assume that each of p{x,y) and « 7 (.r,//) is continuoiish' difTerenti- 
able and vanishes at the origin. Show that if the linear system 


dx 

^ = p^x -h p-a, 
di/ 

^ = (?ij- + g.jj 



where Pi = dpfdx,p2 — Op/dtj.qi = Og/dx, aud g-2 = dg'dij, v(iv]\ 
evaluated at the origin, is asymptotieally stable at tlie origin, 
then 

^ (^,y) = ipi^ + Ihl/y + igiX -H q-:y)- -j- A(.r- -f y-) (iii) 

where A = pig-, — g^p^, is a IJapunov function for (i). In fact, 
show that (ii) is asymptotically stable at the origin. Note first 
that necessarily A > 0 and p\ gi < 0. (Why?) Then show 
that becau.se A 9 ^ 0, 

Kixpj) = {p,X + p-iyY -h + g.yY- > ;H(.r 2 -t- ,f) (iv) 

for a suitable po.'<ifivo constant vi and all x and y. Li fact, show 
that K{x,y) = 0 if and only if j = 0, y = 0 and hence K{x,y) 
> m > 0 on the unit circle x®-f-//-= 1. Then note that 
K[ax,ay) = a'^K{x,y), and explain why (iv) applies throughout. 
Clearly, one has Vix,ij) > (m -j- A)(x2 -f lY) for all .r and y. 
Tinally, using the mean-value theorem, show that in a suitable 
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neighborhood of the origin 

f (Pi++p=) 

and explain why the last two inequalities justify the stated 
conclusions. 

8. Discuss the relationship between Exercise 7 and Theorem 1. 

9. With the notation of Exercise 7, show that along each non¬ 
trivial trajectory x(0, y{t) of (i), (sufficiently near the origin) 
the total i derivative of r(x(0, y(0) satisfies the differential 
inequality 

dt ^ 2 A + M 

where Jl/ is a positive constant such that K{x,y) < M{x" + y-) 
holds throughout. Using Gronwall’s lemma, show that 

lim r(x(0, y{t)) = 0 

f—» » 

and explain the significance of this fact. 

10. Dc.sciibc the level curves of the scalar function of 

(iii). Note that for the linear system (ii) the scalar quantity 
K(x,y) of (iv) is proportional to the kinetic energy while the 
scalar quantity Vix,y) is proportional to the total energy. Illus¬ 
trate for the linear equation d-x/dt- + k dx/dl u-x = 0. 

11. With the notation of Exercise 7, .show that (i) is unstable 
at the origin if the real part of each of the charac’teristic numbers 
of (ii) is positive. Note the signs of A and pi -{- q^, and proceed 
as in Exercises 7 and 9. 

12. With the notation of Exercise 7, show that (i) is unstable 
at the origin if exactly one of the characteristic numbers of (ii) is 
positive. Introduce a suitable linear transformation 


Ui — bi\X “h buy 
Hi — 631X bay 


(v) 
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SO that the system (ii) is equivalent to a system of the form 



dui 

~di 




with, say, Xi > 0 and X-j < 0. Then show that certain solutions 
of the system obtained by applying the transformation (v) to (i) 
reflect the behavior of corresponding solutions of (vi) near the 
origin. Explain why this proves that (i) is unstable. Note that 
one has shown here that the origin is a saddle point for (i) if it is 
a saddle point for the linear approximation (ii). 

13. Using the technique introduced in Exercise 12, show that 
the origin is a node or a focus for (i) if it is a node for the linear 
approximation (ii). Show that the origin is a center or a focus 
for (i) if it is a center for (ii). Show that the origin is a focus for 
(i) if it is a focus for (ii). 



Chapter 6 


TWO-DIMENSIONAL SYSTEMS 


1. Critical Points of Autonomaus Systems 

The concept of a critical point is of particular importance in the 
study of the trajectories of two-dimensional autonomous sys¬ 
tems. The very special (and somewhat restrictive) geometrical 
and topological properties of the Euclidean two-space are 
primarily responsible for this. Indeed, many of the results and 
concepts to be considered in this chapter are peculiarly two- 
dimensional and reflect geometrical or topological properties of 
two-space not shared by higher dimensional spaces. We shall 
consider, throughout, a system 



dt 


= Q{x,y) 



in which the right-hand members are continuously differentiable 

in each variable. Ihus, since (1) is autonomous, through each 

point of x^-space there passes one and only one trajectory. In 

particular, trajectories of (1) never cross or exhibit points of 

contact. This imposes severe restrictions on the geometric 

patterns. We note that a nontrivial trajectory corresponds to a 

periodic solution of (1) if and only if it passes through a single 
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point at two different times. Such a trajectory defines a Jordan 
curve, i.e., a simple closed curve which .separates the j// plane 
into two disjoint, connected point set.s. Further, the inde¬ 
pendent variable i is a “sliding” parameter along each trajectory 
and generally needs to be specified only to the e.xtent of indicating 
the direction of motion along a trajectory. The direction of 
motion is reversed upon replacing / by —while the trajectory 
curves themselves remain unchanged. 

The system (1) defines a direction field 

(lx v{x,\j) 


which is indeterminate only at points where and p{xjj) 

vanish simultaneou.'jiy. Such points, of cour.^e, represcMit singu¬ 
lar solutions (point solutions) of (1), Init in the present context 
are referred to as critical pointa. The latter name is us(‘d to 
emphasize the typically “critical” geometric properties of the 
direction field (2) near such points. This is in contrast to the 
singular dynamical nature of the corresponding point solutions 
of (1). The concepts are related but not (Miuivalent. For 
example, if p(x,y) and q{x,y) have a common factor which 
vani.shes at some particular point, this point always represents a 
singular solution of the dynamical system (1). On the other 
hand, the direction field defined by (2) may not be “(•ritieal" at 
all near such a point since a factor common to pU',!/) and (lix.y) 
cancels in (2). Because it is the dynamical problem we are con¬ 
cerned with, the expression “crilica! point” will always refer 
to a point where p(x,y) and ({{x,!/) vanish .'^imultaneoii.sly whether 
the direction field is actually cj-itical or not. Wo .shall further 
assume that (1) possesses only i.solated critical points. I'hen the 
set of critical points will posse.ss no finite limit points and any 
bounded region will contain at mo.st a finite number of critical 
points. A noncritical point will be called a regular poijit, as 
usual. Generally, but not always, the topological (in fact, geo- 
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metrical) characteristics of the critical points of (1) are reflected 
in the linear approximations of (1) near these critical points. We 
return to this question presently, but first introduce an interest¬ 
ing, often useful, concept. 



Figure 2 


A signifirant property of a critical point P of (1) is its index. 
This is an int<‘g(‘r./ which represents the net rotation (po.sitive for 
countercloi'kwise I'ntation) of tlie direction field along a simple 
closed cur\e (a .Iordan cur\'e) J which is sufficiently smooth and 
encloses the critical point P, but no other critical points. The 
index is a property of P and, therefore, the same for every such J. 
In fact, it is e.xpres.scd as the line integral 
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taken counterclockwise along J. This expression makes it evi¬ 
dent that j varies continuously with any continuous deforraa- 



Fijjure 4 


tions of J which do not lead to encounters with critical points. 
Since it is an integer, it is necessarily constant in the above 
circumstance. 

Evidently, the index of a focus, node, or center is +1, while 
the index of a saddle point is —1 (see Figs. 1 to 4). We define 
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the index of a regular point in an analogous manner and con¬ 
clude immediately that it is zero (see Fig. 5). More generally, 
one may define by (3), the index y for any simple closed curve J 
which is sufficiently smooth and does not pass through critical 
points. Thus j is an integer valued function which is constant 
under any continuous deformations of J which do not lead to 
encounters with critical points. The index of a simple closed 
curve is the sum of the indices of the enclosed critical points. In 
particular, the index of a simple closed curve enclosing no critical 
points is zero. 



Figure 5 


If a simple closed curve J does not pass through any critical 
points and is, at the .'<aine time, a trajectory of (1), then clearly 
tiic index of./ is + 1 (see Fig. 3). Such a trajectory corresponds 
to a nontrivial periodic solution of (1) and evidently must enclose 
at least one critical point. We refer to such a trajectory as a 
periodic orbit. 

We shall conclude this section with a result which implies, 
among other thing.s, that the index of a critical point of (1) is 
generally the same as for its linear approximation. Without 
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loss of generality we may assume that the critical point is the 
origin. 

Suppose pix,y) and q(x,y) vanL-sh sinuiltaneou.'ily at the origin. 
Then we may write 


^ = p(x,y) = piX -f- p2y + p{x,y) 

^ = f}ix,y) = Qix -h q^y -f v{x,y) 



where pi = dp/dx, pt = Op/dy, q\ = dq dx, and q^ = dq dy, each 
evaluated at the origin, and according to the mean-value theorem, 
conclude that 


lim = 0 

ikl + ii/ll-0 l-t'l + I//I 



The latter is the appropriate nonlinearity condition for (4) 
near the origin, and it might be e.xpected that near the origin 
the direction field defined by (4) is essentially given by the linear 
approximation 


(lx 

(it 

cly 

(It 


= P*Cr,i/) = P\x + piy 
= y*U,y) = + q-iH 



The expected does in fact occur if ((i) is not degenerate, that is, 
if the origin is an i.'<olatcd critical point of (b). This is e(iuivalent 
to the nonvanishing of the determinant of the coefficients. We 
obtain the desired result by considering the dot product of the 
vector (p,r/) defined by (4) with the vector ip*,q*) defined by (0). 
This is the scalar (piantity 


^ = ipiX + pzyy + {qiX -b (j2y)^ + (piT -b p2y)p(x,y) 

+ iq\X + q:y)r!{x,y) (7) 


We shall divide (7) by the product of the lengths of the two vec¬ 
tors; the (piotient becomes the cosine of the angle 6 between the 
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two vectors (see Fig. 6 ). On the other hand, if the determinant 


Pi P 2 
q\ 92 


— Pi92 “ 91P2 


is not zero, the two quantities pix + ps?/ and 91 . 1 : + q^y vanish 
simultaneously only at the origin. Thus the quantity 

= (pix 4- piXjy -f (9ix + qiyy 



FiRurc 6 


does not vanish on the square |x| + |y| = 1 . In particular, there 
exists a positive constant in such that 


^'■*(• 1 ’,!/) > m for [xl + jy[ = 1 

Clearly, then, K{x,y) > m(\x\ + iyi)= for all (x.y). The lengths 
of the two \-eetors are given by the expressions 


1 + 


2(pi.t 4- piy)p(x,y) 4- 2{qix 4- 92y)»7(-r,»/) 
__ 4- p-(x.y) 4- 

L* = [A'(x,//))H- 



L = [A'(-r,y)l'-- 
and 
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Hence from (7), we obtain 


cos 6 = 


D 


LL 


I + 


, , (piJ + p 2 y)p(j-.f/) + (^i.r + qiu)n{x,}j) 

_ Kjx.ij) _ 

2(piJ -H Pii/)p(.r,//) + 2(yi.r + U:{i)t]{xjj) 

+ p-{x,ii) + ri-{x,ij) 


K{x,ij) 


( 8 ) 


where 


2 (pi.r + Viy)p{x,ii) + 2{qxx + qi^f)r,{x,\i) -b p-(.r.//) -f i'jx.y) 

^'Ca'.i/) 

^ 2 lp(.r.//)| + |T;(.r,y)| , 1 [ IpC-^^'//)! + hU.'/)l1 ~ /q\ 

“ m'--^ |x| + LvI ^ m [ Ui + i^l J 

and 


I (pi-c + Pi>j)p{x,tj) + {(1\X + <y;v)T?(x..v) ' _I_ (p(.r.//)| + k(x,y)\ 

' /v(.r.,v) - m'- |ji + i//| 

( 10 ) 

The nonlinearity condition (5) thus guarantees that the direction 
fields of (4) and (6) are nearly eoineidcnt near the origin; i.c., 
the angle 6 between corresponding vectors of the t\vo vector fields 
is uniformly small in a complete neighborhood of the origin. 
Clearly, this implies that the index of the origin for (4) is the 
same as for the linear approximation ((>). But even more, we 
have essentially proved Theorem 1. 


Theoiikm 1 

If in the system (4), the coefficients of the explicit linear terms 
satisfy piy-. — q^pi ^ 0 and the pcrturbational terms p(.r,y) and 
T){x,y) are continuous and satisfy the nonlinearity condition (5), 
then the character of the critical point .r = 0, // = 0 is the same 
as for the linear approximation (G) with one possible exception. 
If the critical point is a center for (G) it may be either a center or a 
focus for (4). 
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Proof: In view of the above discussion, the only questionable 
cases arc those involving either foci or centers. But the stability 
theory of Chap. 5 guarantees that a focus for (6) is a focus for 
(4) and that the stability of the focus is the same in each case. 
Thus, the stated exception is indeed the only possible exception. 
If the origin is a center for (G), it may also be one for (4). How¬ 
ever, the inefiualities (9) and (10) do not rule out the possibility 
that it might be a focus for (4). 

We refer to center.^, foci, nodes, and saddle points as elementary 
critical point.s. Tlieorem 1 shows that these are the types of 
critical points that are most likely to occur. 


EXI-RCISES 


1. U.sing (3), verify directly that the ijidex of a focus, node, or 
center is -f 1, the index of a .‘saddle point is —1, (he index of a 
regular point is zero, and the index of a nonsingular closed 

trajectory is H-l. 

2 . Show that the index of a simple clo.sed curve in the continu¬ 
ous vector liekl defined by (1) is the sum of tlie indices of the 
enclo.'jcd critical points. 

3. Determine the index of the critical point of the sy.stein 



Note that the critical point is not a focus, a node, a center, nor a 
saddle point. hat is the liiu^ar approximation to tins system 
near tlie critical point? 

4. Supjjosing that (1) po.s.sos.ses only elementary critical points, 
explain why a periodic orbit of (i) neces.sarilj’^ encloses an odd 
mmiber ot critical points. Explain wliy it is that if such a 
trajectory encloses more than one critical point, not all the 
enclosed criti<‘al points can be stable and not all the enclosed 
critical points can be unstable. 

5. Give some general conditions under which (1) possesses only 
elementary critical point.s. 
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6 . Give a detailed proof of Theorem 1. 

7. Show that a trajectory is a periodic orbit of (1) if and only 
if it passes through a single point at two dilTercnt times. Explain 
why it is necessarily a Jordan curve. 

2. Properties of Lunit Cycles 

We recall that a point C belongs to the positive limit cycle of a 
trajectory V if the trajectory intersects each neighborhood of I* 
for arbitrarily large values of /, the independent variable. The 
positive limit cycle of F is always a subset (po.ssibly empty) 
of (he set of limit points of each po.sitive half path as.'^ociated with 
r. For autonomous sy.stems, as considered here, each half path 
of a trajectory F is characterized as that portion of F extending 
to one side of a point of F. Since the .set of limit points of a half 
path is a closed point .set, so also is the intersection of any num¬ 
ber of such sets. In particular, a limit cycle is always a clo.<ed 
point set. Further, if a positive half path is bounded, then the 
po.sitivc limit cycle is a nonempty closed and bounded point set, 
i.e., a compact set. It may al.so be .shown that the positive limit 
cycle is always a connected point set. 

The following theorems depict other important properties of 
limit cycles. 

Theorem 2 

If a positive limit cycle L of a trajectory F of (1) contains a 
regular point P, then the complete trajectory F* through P is 
contained in L. If in addition L is bounded, then F* exists for all 
t, and the positive and negative limit cycles of F* are each con¬ 
tained in L. 

Proof: Let Pi P be a point of F, Ni a neighborhood of Pi, 
and 7’i a real number. According to the basic continuity theo¬ 
rem of Chap. 3, there exists a neighborhood N of P such that each 
trajectory intersecting N also intersects A^i. If the trajectory F 
moves from P to P| with increasing then this is a direct appli- 
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cation of the continuity theorem. If F moves from Pi to P 
with increasing t, then the continuity theorem is applied to (1) 
with t replaced by — In the latter circumstance, let t be an 
upper bound to the elapse time for travel from Ni to N along 
any trajectory intersecting N\. The existence of the latter is also 
guaranteed by the continuity theorem. Since P is contained 
in the limit cycle L, there exists a time exceeding Tx (or Ti + t, 
as the case may be) such that F intersects N for t = ix. Then 
F necessarily intersects A’, for some U > Tx. This shows that 

Normal 

V 



Pi is also contained in the positive limit cycle of F. If the limit 
cycle L i.s contained in a bounded region, then a standard con¬ 
tinuation argument shows that the trajectory F* through P 
exists feu’ all t and is contained in L. Since L is closed, the 

positive and negative limit cycles of F* are necessarily contained 
in L. 

By arguments similar to those used in the proof of Theorem 2, 
one may show that if P is a regular point of the system (1) and 
F is the trajectory through P, then there exists a neighborhood 
N oi P such that each trajectory intersecting N also intersects 
the normal to F at P, This is essentially a manifestation of the 
uniform continuity of the direction field near P. We may 
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further require that each trajectory in N cross the normal in the 
same direction as does r. One thinks of a locally laminar flow- 
field near P (see Fig. 7). The segment of the normal at P lying 
within N is called a transversal, and the neighborhood X is called 
a path-rectangle. 

Theorem 3 

If a bounded positive half path of a trajectory P of (1) and its 
positive limit cycle L have a regular point P in common, then 
T = L and /. is a periodic orbit. 





Figure 8 FigJiro 9 


Proof: According to Theorem 2, the complete trajectory F 
through P is contained in L. Let us show that T is a periodic 
orbit. In fact, let I bo a transver.sil at /^ and N the correspond¬ 
ing path-rectangle. I./et the trajectory V arrive at P for / = t\. 
Then, since P belongs to the limit cycle L, the trajectory T must 
intersect the neighborhood N, and thence also the tran.sversal I, 
for i > ti. If a second intersection with I is again P, then clearly 
r is periodic. On the other hand, if t^ is the least time e.xceeding 
for which T intersects I at a point P\ dilTerent from P, then that 
portion of the trajectory T mapped out for < / < t-, together 
with the segment of the transversal I between P and P\, defines 
a Jordan curve J (see Figs. 8 and 0). The trajectory F for 
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t > tz lies either completely on the outside of J or completely 
on the inside of J since it cannot cross itself nor the transversal 
between P and P\. In either event, the trajectory cannot return 
to any small path-rectangle at P which excludes Pi. In such a 
case, P could not be a point of the limit cycle L. Since P is a 
point of the limit cycle L, we conclude that the second intersec¬ 
tion of r with the transversal y is necessarily P itself, and hence 
that r is a periodic orbit. Clearly, the trajectory T and its limit 
cycle L correspond to one and the same closed point set. 

A veiy similar argument may be emplo 3 'ed to prove Theorem 4. 

Theorem 4 

If a trajcctorj’ of (1) intersects a transvensal at two points, then 
the trajectory is not contained in any limit cycle of (1). 

Proof: Consider the Jordan curve defined by that portion of a 
trajectory F mapped out between two successive intersections 
with a transversal and the corresponding segment of the trans¬ 
versal. We observe that a trajectory can pass either from the 
inside of this Jordan curve to the outside or from the outside 
to the inside at most once, since it must do so by crossing the 
transversal (see Figs. 8 and 9). Clearly not both points of 
intersection of F with the transversal can belong to one and the 
same limit cycle. 

We now consider the celebrated Poincar^Bendlxson theorem. 
Theorem 5 

Let a trajectoiy F of (1) possess a bounded positive half path. 
If the positive limit c>'cle L of F consists of regular points only, 
then L is a periodic orbit and either F = L or F “spirals” to L 
on one side of L. 

Proof: The hj'potheses imply that L is not an empty set. Let 
P be a point of L. Since it is necessarily a regular point. Theorem 
2 guarantees that the complete trajectory F* through P is con¬ 
tained in L. The positive limit cycle L* of F* is not empty 
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and is also contained in L. Let P* be a point in L*. Now P* 
is a regular point and according to Theorem 3, F* can intersect 
the transversal at P* in no more than one point, since F* is a 
subset of the limit cycle L. Clearly, F* must intersect the trans¬ 
versal in every neighborhood of P*, since P* is, at the same time, 
in the limit cycle L* of F*. Thus F* must intersect the trans¬ 
versal at P* and only at P*. But then according to Theorem 3, 
F* = L* is a periodic orbit. Since the limit cycle L is con¬ 
nected, it cannot contain points other than those of the closed 




Figure 11 


periodic orbit F* = L*. Thus L is a periodic orbit as stated. 
Of the two possibilities for F, if F has a point in common with L, 
then F = L. If F has no points in common with L, let P be any 
point of L. If Ms a transversal at P, then F intersects I consecu¬ 
tively in a succession of points 71 , 72 , . . . on one side of L with 
lim 7 fc = P. In fact, the consecutive intersections of any tra- 

jectory with a transversal necessarily form a monotone sequence 
along that transversal (see Figs. 10 and 11). Clearly, these must 
lie on a single side of L in the present circumstance. 

Finally, we characterize limit cycles in general according to 
Theorem 6 . 
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Theorem 6 

Let a trajectory F of (1) possess a bounded positive half path. 
Then the positive limit cycle L of F is one of the following: 

a. A single critical point of (1) 

b. A periodic orbit 

c. A finite number of critical points of (1) with connecting 
trajectories (nonperiodic orbits) called separatrices, each of which 
has for its limit cycle (positive or negative), one of the critical 
points 

Proof: Clearly each of a and 6 is a possibility. The hypoth¬ 
eses guarantee that the limit cycle L is not an empty set. 
According to Theorem 3, a limit cycle cannot contain both 
critical points and periodic orbits. If it contains no singular 
points, Theorem 5 implies b. If it contains critical points, they 
are but finite in number. Since a limit cycle is necessarily con¬ 
nected, if it contains more than one critical point these must be 
connected by regular points and hence, according to Theorem 
2, by complete trajectories. Clearlj", the positive and negative 
limit cycles of the connecting trajectories are the critical points 
contained in L. Thus, c is the only alternative to either one of a 
or b. 

Example 1 

Theorem 5 implies that if a bounded region li contains a half 
path but no critical points, then it also contains a periodic orbit. 
One can be assured that a bounded region ft contains a half path 
if its boundary consists of two concentric Jordan curves and the 
vector field along the boundary is everj^where directed into (or 
everywhere directed outward from) the annular region between 
the two Jordan curves (see Fig. 12). 

Example 2 

If a Jordan curve encloses exactly one unstable critical point 
and the vector field along this curve is everywhere directed into 
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the interior, then there is a periodic orbit lying within the Jordan 
curve. Of course any periodic orbit lying within the Jordan curve 
must encircle the critical point. Thus if there is more than one, 
the orbits must be concentric. If there is just one, it is necessar¬ 
ily asymptotically orbitaliy stable (see Fig. 13). In fact, each 



Figure 14 


trajectory crossing the Jordan curve must spiral in to the periodic 
orbit, and each nontrivial trajectory within the periodic orbit 
must spiral out to the periodic orbit. There are no other possi¬ 
bilities for the positive limit cycles of such trajectories. For 
exactly the same reason, if there are no critical points or periodic 
orbits between two concentric periodic orbits, such as in Fig. 14, 
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then each trajectory between the periodic orbits has one of the 
periodic orbits for its positive limit cycle and the other for its 
negative limit cycle, i.e., the interior trajectories depict motion 
from one of the periodic orbits to the other for ~ ^ . 


EXERCISES 

1. Explain why the limit cycle of a bounded half path is 
nonempty. 

2. Show that a limit cycle is a connected point set. In fact, 
show that if a limit cycle is the union of two disjoint, nonempty, 
closed sets, then a relevant half path could not be connected. 
Note that two disjoint, nonempty, closed sets are at a nonzero 
distance from each other. 

3. Prove the existence of a transversal and a corresponding 
path-rectangle at a regular point. 

4. Give a detailed proof of Theorem 4. 

5. State and prove results analogous to Theorems 2,3,4, 5, and 
6 for negative limit cycles. 

6 . Justify the statements appearing in Example 1. 

7. E.xtend the results in Example 1 to cases wherein the vector 
field might be tangent to portions of the relevant Jordan curves. 
Thus, in some cases, portions of the Jordan curves might be 
trajectories. Use this and the result in E.xample 1 to prove the 
principal results in Example 2. 

8 . Consider the system 


^ = y + xp(i2 + y^) 


dt 


—X + pp(x* + y*) 



where p is continuous for all positive numbers. Show that (i) 
leads to the single equation 



It = 2rV(r’) 
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for r- = X® + t/®. Explain why the origin is the only critical 
point of (i). Suppose that the function p has a positive root 
ro^ Then = ro* is a singular solution of (ii) and + y- = ro* 
is a periodic orbit of (i). Suppose, further, that p posso.<.ses only 
a finite number of positive roots. Characterize the stability 
characteristics of the origin and each of the periodic orbits of (i), 
corresponding to the positive roots of p, in terms of the sign of p 
between the roots. 

9. Discuss the trajectories of the system 


J^ = y + - I’ - '/■) 


di 



for various positive constants /?*. 
10. Con.sider the divergence 


tiiv ip,q) = ^ + 


dy 


of the vector field defined by (1). As the name implies, the 
quantity div ip,q) at a point is a measure of the extent to which 
the vectors near that point are diverging (separating). A 
negative divergence means that the vectors are converging. 
Therefore, the sign of div (p,< 2 ) along a trajectory is an indicator 
of stability. If div (p,q) is negative everywhere along a tra¬ 
jectory, then the trajectory would appear to be orbitally stable. 
For a periodic orbit, one might expect a little more. The 
neighboring trajectories of a periodic trajectory must accom¬ 
pany (approximately, of course) the periodic one, and so it 
would appear that the stability should be indicated merely by 
the sign of the average of the div {p,q) along a periodic trajectory. 
Explain the relationship between this “intuitive” result and the 
Poincar6 criterion for orbital stability discussed in Example 12 
of Chap. 5. 
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11. Using Green’s theorem, show that the total (and hence 
the space average of the) divergence of the vector field (p,q) 
within a periodic orbit of (1) must vanish. Explain why this is 
“intuitively” necessary. What would a positive or negative 
total or average divergence signify? 

12. Consider the van der Pol equation 


d^x 




where is & positive constant. One may use the Poincar^- 
Bendixson theorem, Theorem 5, and show that (i) possesses a 
periodic orbit. First show that (i) is equivalent to the system 



Note that this is not the usual phase-plane equivalent of (i). 
Show that the origin is the only critical point of (ii) and that it is 
unstable. The direction field defined by (ii) may be expressed 
in the form 


^ __ X _ 

dx y n{x - xV3) 



Thus, in particular, a trajectory becomes horizontal only as it 
crosses the y axis and becomes vertical only as it crosses the cubic 

r - (iv) 

The cubic curve (iv) is illustrated in Fig. 15. Explain why the 
trajectories of (ii) are symmetrical with respect to the origin. 
Then using (iii), show that each nontrivial trajectory P which 
intersects the cubic curve (iv) for x > \/3 is qualitatively as 
shown in Fig. 16. Next observe that the quantity E = x* + y* 
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(proportional to the energy) satisfies the differential equation 

dE ^ (x^ \ 

Tl = (^3 - ( V ) 

along each trajectory of (ii). Thus, E decreases along any por¬ 
tion of r lying to the right of x = In fact, from the second 
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Figure 15 


equation in (ii) and (v), one has 


dy 



and so the decrease in E along any portion of T to the riglit of 
X = y/Z will numerically exceed the change in y for that portion 
multiplied by the minimum value of 2 m(xV3 - x) over that 
portion. Explain why the decrease in E along the totality of V 
lying to the right of x = -\/5 is numerically unbounded as the 
intercept of r with the cubic (iv) moves to the right. On the 
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other band, from the first equation in (ii) and (v), one has 



and so the increase in E along any portion of T lying between 
X = 0 and x = \/3 does not numerically exceed the change in x 
multiplied by the maximum of the right-hand member in (vi). 
Explain why the increase in E along each of the two portions of r 
lying between x = 0 and x = \/S is bounded and, in fact, tends 
to zero as the intercept of F with the cubic (iv) moves to the 
right. Now explain why the y intercept of the trajectory F 
above the x axis is farther from the origin than is the y intercept 
of F below the x axis, provided the intercept of F with the cubic 
(iv) is sufficiently far to the right. Finally, use a loop of such a 
trajectory F and its reflection in the origin, together with suitable 
segments of the y axis, and define a Jordan curve J w'hich encloses 
the origin and for w'hich the direction field is everywhere either 
tangent to J or directed into the interior of J. Explain w'hy this 
shows that (ii), and hence (i), possesses a periodic orbit. 

13. By arguments similar to those used in Exercise 11, show' 
that a trajectory F of the van der Pol system (ii) which inter¬ 
cepts the cubic (iv) between a: = 0 and x = \/3 possesses a y 
intercept above the x axis which is nearer the origin than is its 
succeeding y intercept below the origin. Show therefore that 
the periodic orbit of (i) is unique. Why is it necessarily asymp¬ 
totically orbitally stable? 

14. Discuss the trajectories of the van der Pol equation (i) 
for /i < 0. Note that changing fi to —fi in (i) is equivalent to 
changing t to — 

15. I'or 1^1 small, the periodic orbit of the van der Pol equation 
(i) is very nearly a circle. This becomes clear if one examines 
the direction field of the equivalent system (ii). This is the 
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Li^nard plane associated with (i). As |m| decreases, the illustra¬ 
tion in Fig. 15 is modified so as to move the cubic curve (vi) 
closer to the x axis, as in Fig. 16. For ^ = 0, the cubic passes 
to the X axis. 

The direction field at a point {x,\j) in Fig. 16 is given by (iii) 
and, as indicated, is perpendicular to a ray drawn from a point P 
on the \j axis only slightly removed from the origin. Explain 
why this is a valid geometric interpretation of (iii). If tlie ray 
were always drawn from the origin, the trajectory would be a 



Figure 16 


circle with the origin as center. Because of the slight movement 
of P away from the origin as one progresses along a trajectory, 
the trajectory itself deviates slightly from a circle. Using this 
construction (the Licnard construction), explain why it is that the 
trajectories near the origin necessarily spiral outward, while 
those at some distance from the origin necessarily spiral inward. 
The periodic orbit is that unique trajectory along which the two 
effects, during one rotation, exactly balance. 

16. Using the Li6nard construction, discuss the trajectories of 
the van dcr Pol system (ii) for large p. For this discussion, 
replace the independent variable thy t = tit and the dependent 
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variable yhyz = y/n. Note the limiting fonn for the periodic 
orbit in the xz plane as /x ^ . Show that the corresponding 

motion for (i) is a very jerky type of motion. This is called 
relaxalion oscillation. The ordinary phase-plane trajectories of 
(i) for ti large are illustrated in Fig. 17. By plotting isoclines 



Figure 17 


or by other geometric methods, show that this illustration is 
qualitatively correct. 

17. Consider an equation of the form 

S? + ^ =0 

Introduce suitable assumptions concerning the functions/(x) and 
g{x) so that the essential arguments used in the discussion of the 
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van der Pol equation carry over to a general family of similar 
equations. 

18. Rephrase the results of Exercise 17 for the system 

S ^ (s) + 

noting that if F and G are each continuously differentiable, then a 
solution of (vii) also satisfies the equation 

(I X . jr,/ / (lx '\ (I X . , V (lx „ / •••\ 

de + ^ \li) dt-+ ^ di ^ ^ 

Consider, in particular, the case6’(x) = x and the ordinary phase- 
plane trajectories of (vii). Explain the relationship between 
these and the Li6nard plane trajectories of (viii). Illustrate for 
the van dcr Pol case. 

19. Introduce a Li^uiard-type construction for e(iuations of the 
form d'^xldi- -|- F{dx/dt) t = 0, using a geometric interpreta¬ 
tion of the direction field 

dx y 

in the usual phase plane. Con.sider the locus x = F{ij) and an 
appropriate ray originating along the x axis. 

20. Apply the Li<5nard construction of Exercise 10 to the 
equation d'^xfdt^ ± A: -j- w-x = 0, where the plus .sign prevails 
whenever dx/dt > 0, and the minus sign whenever dx/dt < 0. 
This type of damping is called Coulomb damping (or sliding fric¬ 
tion). Integrate the equation in closed form, and discuss the 
relationship between the closed form solutions and the geometric 
solutions in the phase plane. 



Chapter 7 


PERTURBATIONS OF PERIODIC 
SOLUTIONS 


1 . Perturbations of Periodic Solutions 
in Nonautonomous Systems 


We continue here the quest for, and study of, periodic solutions 
begun in the previous chapter. A number of results will be 
presented for rather general n-dimensional systems and a number 
for special two-dimensional systems. However, the latter are 
not peculiarly two-dimensional necessarily, as were most of the 
results of the previous chapter. Generally, the two-dimensional 
version is used for ease of expression or for greater practical 
emphasis. Also, in contrast to the previous chapter, we shall 
here be concerned with nonautonomous as well as autonomous 
systems. As implied by the chapter title, all the results are of 
a perturbational character. 

In a typical circumstance, one is concerned with the forced 

oscillations of a nonlinear system in which the forcing function is 

periodic. The study of the possible periodic responses of the 

same period may well be of first importance. The system may 

be one of a class of systems for which one member of the class is 

either very simple (it may be linear, for example) or for some 

reason or other has been previously investigated. If the 
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one 
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system possesses a periodic response, a number of rather natural 
questions arise: Do the neighboring systems also possess periodic 
responses? Is the one periodic response a member of a continu¬ 
ous (or possibly analytic) family of periodic responses? Are the 
stability properties of the one periodic response reflected in 
neighboring periodic responses? 

Consider, for example, a system 

fir 

( 1 ) 

where ^ is a real (scalar) parameter, and where the right-hand 
member is continuously dilTerentiahle in each variable and is 
periodic in ( of period t > 0. Suppose that for ^ = 0, (1) 
possesses a periodic solution p{l) of period r. The stability of 
this periodic solution may be reflected in the equation of first 
variation 

^ =/i(/K0, 0)y (2) 

In fact, if the trivial solution of (2) is asymptotically stable, then 
the periodic solution ;■)(/) is asymptotically stable. It is intri¬ 
guing to find that asymptotic stability of the origin in (2) also 
guarantees that for each sufficiently small value of |(3[, Eq. (1) 
possesses a periodic solution of period t. More generally, we 
have Theorem 1. 

Theorem 1 

If the equation of first variation (2) has no solution of period r, 
(other than y = 0) then for each I)9| sufficiently small, (1) 
possesses a (unique) solution which is periodic in t of period 
T and continuous in the pair (/,/3) with lim = p{t) imi- 

formly for all /. 

Proof: The idea of the proof is to imbed the periodic solutions 
in a much larger family of solutions. Rather, we consider 
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a family of (not necessarily periodic) solutions of suflBcient 
generality that we are able to discover the desired periodic 
solutions imbedded within this family. To be specific, let x{t,0,c) 
denote the (unique) solution of (1) satisfying the initial condition 

^(0,j3,c) = p(0) + c (3) 

The hypotheses imply that for each /9 and c the solution 
exists, at least for a positive interval of time. For |/3| and | c | 
small, the solution x{t,0,c) approximates the periodic solution 
p(t) = i(<,0,0). In particular, we shall always assume that |/3| 
and I c I are so small that the solution x{t,fi,c) exists, say for 
0 < < < 2t. Since the system (1) is periodic in t of period r, 
the solution x(t,0,c) will be periodic with period r if 

£(t,0,c) = £iO,$,c) 

or, what is the same, if 

x{t,P,c) - p(0) - c = 0 (4) 

We may regard (4) as an algebraic equation in c and /?. Clearly, 

for |8 = 0, (4) possesses the solution c = 0, corresponding to the 

periodic solution p{t) = x((,0,0). Thus, if the appropriate 

Jacobian [determinant of the derivative with respect to c of 

the left-hand member in (4)] does not vanish for = 0, then the 

implicit function theorem guarantees that for each sufficiently 

small [/3|, (4) possesses a (unique) solution c = c(/S) which is 

continuous in p (in fact, continuously differentiable in p) with 

lim c = 0. This means that for each sufficiently small |^|, there 
^0 

exists a (unique) choice of initial vector c(/3) so that the particu¬ 
lar member 

i{t,P, m) = HW 

of the general family is a periodic solution of (1) of period r. 
Clearly lim x{t,p, c{P)) = p{t), uniformly for all t, since the con- 

vergence is uniform over one period r. On the other hand, the 
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referenced Jacobian is the determinant 


J = |x,M.O) - /| 

where I is the identity matrix and j^(r,0,0) is the Jacobia 


dxx 

dxi 

dXi 

dci 

dc2 


BXi 

Bxz 

dXi 

dc\ 

• • • 

dc2 

# « » » 

dC„ 

dXn 

BXn 

• ♦ ♦ ♦ ♦ 

dXn 

dCi 

dc-i 

dCn 


evaluated for /? = 0, c = 1), and / = t. If we consider 



n matrix 



for the 


moment the Jacobian matrix ((>) and the general family of solu¬ 
tions of (1) for arbitrary (independent) jS and c, then we 

observe (by difTcrentiation in (1)) that A' = Xi is a solution of the 


matrix equation of first 

(it 


variation 


= UHtM, t, fi)X 



For ^ = 0 and c = 0, (7) becomes 

(ix 

-Jf = Mp( 0, t, 0)X (8) 

which is the matrix equation associated with the vector equation 
of first variation (2). Thus the Jacobian x, in (0). evaluated 
for /9 = 0 and c = 0, is a matrix solution A”" = of (8). But, 
by differentiation in (3), it follows that XiiO,0,c) = I (the identity 
matrix) and so, in particular, that .fe(0,0,()) = I. Hence .iv(t,0,0) 
is the priiKnpal matrix solution }'{() of (8). Tlie determinant 
(5) may be reformulated as 

J = \Y(t) - I\ (9) 

Now (9) is zero if and only if the matrix Y{r) has the number one 
for a characteristic number (eigenvalue). In this circumstance, 
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the characteristic numbers are referred to as characteristic multi* 
pliers. What is significant here is the fact that the vector 
equation of first variation (2) possesses a nontrivial periodic 
solution of period t if and only if one of the characteristic multi¬ 
pliers is unity. Thus, in particular, if the vector equation of 
first variation (2) has no periodic solutions of period t (other than 
y = 0), then the determinant J in (9) cannot be zero and hence 
the (unique) family of periodic solutions i(<,/S) exists, as shown 
above. 

Example 1 

Consider the linear scalar equation dx/dt -1- /Sx = cos t. For 

= 0, X = sin i is a periodic solution of period 27r. The equa¬ 
tion of first variation is dy/dt + /?!/ = 0 and, for ^ = 0, certainly 
does not admit a periodic solution of period 2ir other than y = 0. 
Thus there exists a (unique) family of periodic solutions of 
period 2ir for small |/3| converging to x = sin i as jS —» 0. This 
is the family x = [/3/(l + /3“)1 cos t + [1/(1 + ^®)] sin t 

Example 2 

The harmonically forced Duffing equation 

^ -h /Sx* = F cos M 

possesses, for/3 = 0, the periodic solution x = [F/(a>* — X^)] cos \i 
of period 2ir/X, assuming )X| ^ |c>)|. The equation of first varia¬ 
tion is d?y/di^ -h (w- + 3/3x^)y = 0 which, for j8 = 0, becomes 
d'y/dt^ -h a)^y — 0. This equation admits only nontrivial peri¬ 
odic solutions of the periods ±27r/w, ±4ir/w, ±67r/w, . . . . 
Thus if X <jj/N for each integer N, then the harmonically forced 
DufiBng equation possesses a (unique) family of periodic responses 
for small [/S], each with a period of the harmonic input (forcing 
function), which converges to x = [F/(&>* — X*)j cos Xf as /3—»0. 
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Example 3 

Consider the Mathieu equation d-x/dt^ + (w* -f- « cos t)x = 0. 
Since it is homogeneous and linear, it is its own equation of first 
variation. Thus, if the Mathieu equation possesses a periodic 
solution of period 27r, so also does its equation of first variation. 
It is not surprising then to find that periodic solutions of period 
27r occur only for very special values of the parameters and «. 
These special parameter values map out certain curves of tlie 
w-€ plane. If to* = /(e) is the equation of a portion of one of these 
curves, then the Mathieu equation d-x/dt- + (/(e) + e cos ijx = 0 
possesses a periodic solution of period 2ir for eacii e in some 
interval. For each such e, the equation of first variation also 
possesses a periodic solution of period 27r. Thus, the existence 
of periodic solutions of the equation of first variation of a system 
does not preclude the possibility of a continuous family of periodic 
solutions of that system. 


EXERCISES 

1. In the notation of Theorem 1, show that the solution 

is periodic with period t if and only if it satisfies (4). 

2. Show that the Jacobian matrix (0) satisfies (7). 

3. Show that (2) possesses a periodic solution of period t 
(other than ^ = 0) if and only if the determinant in (9) is zero. 
First, explain why (2) possesses a nontrivial periodic solution of 
period r if and only if there exists a constant vector c 0 such 
that Y{t 4- t)c = Y{t)c for all where Y(t) is the principal 
matrix solution. Then observe that K(( + r) = }'{/) r(r) for 
all t and hence that the above is equivalent to the equation 
K(t) c = c. Complete the argument. 

4. Explain why there exists a matrix B such that l’(r) = 
where Y(l) is the principal matrix solution of (8). In the present 
circumstance, the characteristic numbers of B are referred to as 
characteristic exponents. Show that if zero is a characteristic 
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exponent, then one is a characteristic multiplier, and hence (2) 
possesses a periodic solution of period r. In what sense is there a 
“converse” to this? 

5. Discuss the possible periodic responses of the harmonically 
forced van der Pol equation 

|5 + M(*=-l)| + x = ^’cosXi 

for small \n\. 

6. Discuss the possible periodic responses of the harmonically 
forced Mathieu equation d^x/di^ + (w* + « cos t)x = F cos \t for 
small |<{. 

7. Let c = c{0) be the continuously differentiable vector func¬ 
tion introduced in the proof of Theorem 1. Show that its 
derivative dc/dfi satisfies the equation 

. dc , dx dc TT 

where x = x(t,/3,c) is the quantity introduced in the proof of 

dx 

Theorem 1, and hence for small |/S|, that dc/d0 = (/ — Xe)"^ ^ 

Thus, since c(0) = 0, s (/ — Xc)o”‘(dx/di3)oj3, where the 

subscript “0” denotes the value of the quantities for jS = 0, 
is a good first approximation to c(/3). One might define a 
sequence of successive approximations by the recursion formula, 
c(*+» = (/ - Xe)o~*[-^(’'t)3,c'*0 — p(0) — (Xc)oc**^]. Show that this 
sequence of successive approximations converges to the unique 
solution c — c(/3) of (4). Note that x(t,/S,c) is continuously differ¬ 
entiable in each variable. 

8. Explain why the periodic solution x(i,/3) constructed in 
Theorem 1 is analytic in /3 if the right-hand member in (1) is 
analytic in x and /3. Show how to construct the power-series 
expansion of x{t,0) about /S = 0. 


It is noteworthy that Theorem 1 is a comparison theorem con¬ 
cerning, in general, nonlinear systems throughout (see Exam- 
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pie 4). There is no necessity for (1) to be linear for /3 = 0. 
However, in many situations this is just the crux of the matter. 
As in Example 2 above, it may be possible to transfer some 
of the understanding of a linear system to a nonlinear one, at 
least for small changes. In this connection, one might con.«ider 
a continuation process, somewhat like the familiar analytical 
continuation process, as a technique for studying large change.s. 
As the parameter say, is increased. Theorem 1 guarantees the 
existence of a periodic solution for each ^ in a neighborhood 
of a particular value 0o so long as the corresponding equation 
of first variation with respect to j(/,.do) has no periodic solution 
of the same period (other than y = 0). The process is inter¬ 
rupted only if one encounters a do for which this is not true. 
The continuation process guarantees that there will be a smallest 
such do. This is not viewed as a practical procedure, however, 
any more than is analytical continuation. 

If the equation of first variation (2) is asymptotically stable at 
the origin, then certainly it docs not admit a (nontrivial) periodic 
solution of any sort. Thus, Theorem 1 guarantees the existence 
of periodic solutions for d 0 which are near the given one pU). 
We refer to the periodic solution f){t) as a generator of the family 
x{t,Q) of periodic solutions. Hut even more, if (2) is asymp¬ 
totically stable at the origin, it follows that the corresponding 
equation of first variation for d 0, with |d| sufficiently small, 
is also asymptotically stable at the origin. Indeed, this is a 
direct application of the second part of Theorem 8 of Chap. 4. 
For, with |d| small, the equation of first variation uniformly 
approximates (2); i.e., Jt{x{t,0), t,ff) uniformly approximates 
/i(p(0i f,0). Thus we have Theorem 2. 

Theorem 2 

If the equation of first variation (2) is a.symptotically stable at 
the origin, then for each |d( sufficiently small, (1) possesses a 
(unique) asymptotically stable solution j(/,d) which is periodic 
with period r and for which lim x(<,d) = p{t), uniformly for all t. 
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Proof: Apply Theorem 1 of the present chapter, Theorem 8 
of Chap. 4, and Theorem 3 of Chap. 5, in that order. The details 
are left for the student to supply. 


Example 4 

Applications of either Theorem 1 or 2 when the generator 
f{l) is a trivial periodic solution (a singular solution) present 
interesting variations. The quasi-linear system 

= Ax + m,t) ( 10 ) 

where A is constant and }{x,t) is continuously differentiable and 
periodic in i with period t > 0, is an illustration. If the linear 
system dx/di = Ax admits no periodic solutions of period r 
(other than x = 0), then, for each |j3| sufficiently small, the 
quasi-linear system possesses a (unique) periodic solution x{t,0) 
of period t, with x{i,0) — > 0 as /3 — ♦ 0. If the origin is not a 
singular point of the quasi-linear system, then the periodic 
solutions for 0 are not trivial, even though the generator is. 
Of course, each periodic solution is asymptotically stable if the 
linear system is asymptotically stable at the ori^n. 

EXERCISES 


1. Give a detailed proof of Theorem 2. 

2. Explain the applications of Theorems 1 and 2 made in 
Example 4. 

3. Explain w’hy the quasi-linear system (10) does not exhibit 
nontrivial periodic motions in a neighborhood of the origin if the 
origin is a singular solution for sufficiently small |/3|. 

4. Explain why the equation 



+ = ^Fq cos 


where fc > 0 and w® > 0, possesses, for each |/3| sufficiently small, 
a unique, asymptotically stable periodic solution x(i,/3) of period 
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2ff/X for which x{t,0) —♦ 0 as » 0, uniformly for all t. What 
is the analogous result if one has k < 0? Note the rather sharp 
contrast these results make with those derived for an autonomous 
system in Chap. 6. 

5. Consider the equation d^x/di- + g{x) - /3 cos \t, where the 
nonlinear spring term ^(x) is continuously difTerentiable, vanishes 
for X = 0, and satisfies <?'(0) 9 ^ 0. Discuss the possible periodic 
solutions of period 2ir/X of this equation for small l/3[. 


2. Periodic Solutions of Nonautonomous 
Quasi-harmonic Equations 


An important situation, not covered in Theorem I, is repre¬ 
sented by the quasi-harmonic equation 


where/(x, y, I, /3) is continuously differentiable in each variable 
and periodic in i with period 2 t. In this case, the variational 
equation for = 0 is the equation d-y/dt- y = 0 and so pos¬ 
sesses not one but two (independent) periodic solutions of 
period 2ir. Thus, in the search for periodic solutions of (11) 
of period 27r, a fresh attack is called for. We again resort to the 
integral-equation technique which we have used repeatedly 
throughout the earlier chapters. 

Using (44) of Chap. 4, (see also Example 4 of that chapter) we 
conclude that any solution of (11) satisfies the integral ccpiation 

x{t) = a cos f -{- 6 sin f -H /3 

( 12 ) 

with 


sin {t — s) f 


( 4 s), n) 


(is 


^ (0 - — a sin ( -f 6 cos ( + /3 cos (f — s)/^ 


x(s),^.s 


, ds 

(13) 
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The initial conditions are x *= a and dx/di — b for t = 0. The 
solution is periodic with period 2 t if x = a and dx/dt = b also 
for t = 2v. For ^ 9 ^ 0, these conditions are met in (12) and (13) 
if and only if 



sin s / ^x(s), s, ds == 0 

cos s / ^x(s), s, j5^ ds = 0 



We may regard the general solution of (12) [and hence of (13)1 
as a function x(t, a, b) of ^ and the initial values a and b as 
well as t Then the system (14) may be expressed in the form 


sin 5 /^x(s, a, 6 ), 




^ (s, 0, a, b), 8,0^ds = O 


2t 


cos sf 


^x(s, 0, a, h), 


(15) 


^ (s, 0, a, h), s, 0^ds = 0 


Suppose that this algebraic system possesses the solution a — a®, 
b — bo [or 0 — 0. That is, suppose that 


Hiiao, bo, 0 ) == sin s/(ao cos s + 6 ® sin s, 

— a® sin s + 6 ® cos 5 , s, 0 ) ds = 0 

f 2t (15) 

^^ 2 ( 0 ®, bo, 0 ) = r cos 5 /( 0 ® cos s + 60 sin s, 

— a® sin s + 6 ® cos s, s, 0) ds — 0 


We inquire into the possibility of a solution for /3 0 passing to 

a = Cc, 5 = 6 ® as jS —» 0. The pertinent Jacobian is given by 


J {0,a,b) 


dHi djdi 
da db 
dHi dHi 



da db 
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and needs to be evaluated for a = ao, b = bo, and /3 = 0. We 
note that 

dHx \. . . dx. 


where 


da 

dH 


- = sin s I /iJa \ ds 


db 

dHj 

da 

dHt 

db 


■I 


ds 


sin s \fiXb + /■> ~ I ds 


ds 


2' dx 

cos s fiXa + 


cos s /iXft + A I ds 


] 

] 

ds \ 


f = ^ f 

•'* dx dy 


dx 


dx 


da db 


For ^ = 0, 

I I • dx 

X — a cos s + 0 sin s -r 

ds 


= —a sin s + 6 cos s 


Xa = cos s 


dxt 

ds 


= — sin s 


Xb = sin s 


, dxb 

and -r- = cos s 

ds 


and if these are evaluated for a = ao, b = bo and substituted into 
the above, one obtains for J{0, ao, bo) an explicit expression in 
terms of the solution (oo, bo) of (lb). If J{0, Oo, bo) ^ 0, then 
for each \d\ sufficiently small, the algebraic system (15) possesses 
a (unique) solution 

a = a(/3), b = bid) 

with lim a(fi) = ao and lim 6(/3) = bo. The corresponding peri- 

fi—O 0—0 

odic solutions x{t,d) = d, aid), bid)) of (11) converge (uni¬ 
formly in 0 as —* 0 to the generating solution 

xit,0) = ao cos t + bo sin t 

It should be noted that we have discovered the periodic solu¬ 
tions imbedded within a general family of solutions. In this 
regard, the treatment is similar to that used in the proof of 
Theorem 1. However, in the present case, one first determines 
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a candidate for the generating solution using (16), and only then 
seeks the neighboring periodic solutions. It is clear that (16) 
is a necessary condition for the existence of generator of a family 
of periodic solutions of (11) with |/3| small. In general, the 
solution pairs (ao, 6o) of (16) will be isolated. Those which cor¬ 
respond to actual generators of periodic solutions are referred to 
as bifurcation pairs. This has reference to the amplitude 

A(^) = [aH0) + 

plots of the periodic solutions. The curves A(fi) versus /J 
generally extend from bifurcation points Ao = [oo* + along 



/3 = 0 (see Fig. 1). Along /3 = 0, every amplitude represents a 
periodic solution of (11), while for /3 0, typically only selected 

amplitudes represent periodic solutions of (11). The latter stem 
from what are called bifurcation amplitudes. The question of the 
stability of the periodic solutions could be investigated in much 
the same manner as the orbital stability of autonomous systems, 
(Example 12, Chap. 5) but will not be pursued here.^ Suffice it 
to remark that only orbital stability can in general be anticipated. 

^ For the analytical case, see S. Lefschetz, “Differential Equations: 
Geometric Theory’,” pp. 299-303, Interscience ^blishers, Inc., New York, 
1957. 



PERTURBATIONS OF PERIODIC SOLUTIONS 207 


Example 5 

Consider the harmonically forced Duffing equation 

^ + (1 + = 0Fi> cos / 

ar 

Here, a and Fo 9 ^ 0 arc fixed constants. The forcing function is 
“soft” when j/S] is small and the “natural” frequencies of the 
homogeneous systems are nearly unity. In this case we have 
= —ax — x^ + Fo cos t for the right-hand member in 
(11) and (16) becomes 

Hi{aa, bo, 0 ) = [- sin s(ao cos s + bo sin s)a 

— sin s(ao cos s bo sin 5 )® + Fo sin s cos s] ds = 0 

Hz{ao, bo, 0 ) = [- cos s(ao cos s -f- 60 sin s)j 

— cos s(ao cos s H- 60 sin sY -j- Fo cos- si ds = 0 

When these are expanded and the integrals are evaluated, one 
finds that 60 = 0 and that Oo satisfies 

Fo - <700 - 3 ^ 00 = = 0 (18) 

The requirement J(0, Oo, bo) = JiO, oq, O) 9 ^ 0, where J is given 
by (17) reduces merely to the requirement that oo be a simple 
root of (18). Thus, excepting those cases of a double root, (18) 
yields either one or three bifurcation amplitudes |ao[. [Of course, 
only real roots of (18) are significant here.j Tigure 2 illustrates 
the various cases. Of course, the double roots occur at the 
turning points of the constant Fo curves of Tig. 2. 

EXERCISES 

1. Explain why (IG) is a necessary condition for the existence 
of a generator of a family of periodic solutions of ( 11 ) with \0\ 
small. 




Figure 2 
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2. Verify the results stated in Example 5. In particular, 
derive (18) and show that J = 0, where J is given by (I7j. if 
and only if (18) possesses a double root. 

3. Discuss the special significance of the Fo — 0 curve in Fig. 2. 
Explain how it might be computed exactly for each d. Notice 
that (18) possesses a double root along the Fo = 0 curve. Obtain 
an equation for the locus along which (18) possesses a double 
root for fo ^ 0. 

4. Explain how to reformulate the equation 


d-x 

dF 


+ a>-x = F cos \t 


for small |f| and for jXj nearly equal to [u>[, so as to apply the 
results of Example 5 in a study of the periodic solution.'* of period 
27r/X. Describe the corre.sponding amplitude-fre(iuen(‘y plot 
with w- fixed, F a parameter, and fre<juency X as independent 
variable. 

5. Discuss the possible periodic solutions of period 27r of the 
slightly damped, harmonically forced Duffing eejuation 

^ + (1 + »<r)x + 0x= = HF, cos / 

Note that the essential role of a small damping term Ls to link 
together the separate branches of the constant fo curves of Fig. 2. 


3. Perturbaliovs of Periodic Solutions 
in Autonojnous Systems 

The autonomous case is at once more difficult to treat than is 
the nonautonomous case, since the equation of fir.st variation, with 
respect to a periodic solution, always possc.s.ses a similar periodic 
solution. This necessitates some modification not only in the 
ba.sic analysis, but also in the anticipated results. For if the 
continuou.sly differentiable, autonomous system 


ft = 


( 19 ) 
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possesses a nontrivial periodic solution fit) of period to, say, for 
/3 = 0, then the most one can anticipate for (19) with jS 0, is 
that it possess a nontrivial periodic solution of period r(/3) 
(in general, different from to) with lim t(/J) = to and 

/ J -*0 

lim x(f,/3) = p{i) 

^0 

uniformly on each finite interval of i. In favorable circum¬ 
stances, we shall show that the latter does occur. 

If p{i) is a nontrivial periodic solution of (19) for /3 = 0, then 
the equation of first variation 

% = A(P(0, 0)y (20) 

possesses the nontrivial periodic solution dp/dl. Since (19) is 
autonomous, we may assume that the origin for I is chosen so that 
dp/dt ^ 0 at t = 0. Then by a suitable linear transformation 
u = Bp, [B| 5^ 0, (20) may be transformed to an equivalent 
linear system whose principal matrix solution contains the trans¬ 
formed periodic solution u* = B dp/dt as a column vector. 
This is accomplished by a rotation (w’hich aligns one of the new 
coordinate axes with dp/dt for i = 0) followed by a simple scale 
factor change (which renders u* a unit vector for t = 0). The 
same linear transformation may be applied to (19) with the 
result that Bp{t) becomes the corresponding periodic solution for 
^ = 0 in the transformed coordinates. Thus, there is no loss 
in generality if we assume from the outset that in the original 
coordinate system, dp/dt appears as a column, say the first 
column, of the principal matrix solution Y{t) of (20). 

Now denote by x((,/3,c), the (general) solution of (19) satisfying 
the initial condition x(0,/3,c) = p(0) c. Clearly, 

x((,0,0) = p{i) 

As in the proof of Theorem 1, it follows that the Jacobian matrix 
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Xe is the principal matrix solution of the equation of first variation 
of (19) with respect to x. In particular for /3 = 0 and c = 0, the 
Jacobian matrix Xe is the principal matrix solution r(I) of (20). 
The characteristic multipliers of the periodic system (20) are the 
roots X of the algebraic equation 
\Y{to) - X/| = |x, - X/| 


dxj 

dxi 

dxi 

- X 

- - . 


dci 

dCi 

dCn 

dX2 

dXi 

’ A 

dXi 

dci 

A A A A * 

dCi 

dCn 

9 V V w w 

dXn 

dXn 

Sx„ 

• • • - — A 

dci 

dC2 

dc„ 



As indicated above, we may assume that the first column of }”{() 
is periodic with period ro, and it then follows that the first 
column of y(To) contains the entries 1, 0, . . . ,0. Thus, the 
first column in (21) contains the entries 1 — X, 0, . . . , 0, and 
(21) may be reduced to the product 


(1 - X) 


dX2 

dx2 

Sxo 

—= - X 
dC2 

Sc 3 

SCn 

dXi 

SX3 

Sx3 

-X 

• • • —• 

dC2 

dc3 

SCn 

dXn 

Sx„ 

SXn 

dc2 

Sc 3 

SCn 


= 0 ( 22 ) 


This equation exhibits, in bold fa.shion, the fact that X = 1 is a 
characteristic multiplier of the periodic system (20). We con¬ 
sider now the case where X = 1 is but a simple root of (22). We 
have Theorem 3. 


Theorem 3 

If X = 1 is a simple characteristic multiplier of the equation of 
first variation (20), then for each |/3| sufficiently small, there exists 
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a (unique) periodic solution x(i,/3) of period t(/3) of (19) with 

lim t(/3) ~ ro and lim = p(t), uniformly on each finite 

^0 e-*o 

interval for t. 

Proof: We consider the subfamily of solutions £(t,/S,c*) of (19) 
for which the initial vector p(0) + c* in each case has for its first 
component, the first component of p(0). Thus, the first com¬ 
ponent of c* is always zero. For c* othenvise arbitrary and /S 
arbitrary, these solutions are not necessarily periodic, but we 
shall find imbedded within this family of solutions the periodic 
ones. We restrict considerations throughout to sufficiently small 
values of |/3| and | c* | in order that the corresponding solutions 
exist at least on an internal for i exceeding ro in length, say on 
0 < i < 2ro. Then since (19) is autonomous, the solution 
x(t,0,c*) will be periodic with period r > 0 if (and only if) 

x{tAc*) - p(0) -c* = 0 (23) 

Note that for /9 given, (23) is a system of n equations in the n 
variables r, c?, . . . , c„. For 0 — 0 , the system possesses the 
solution T = To, c* = 0. It will, for sufficiently small |/3| ^ 0, 
also possess a (unique) solution (t(/3), c*(/ 5)] provided the Jaco¬ 
bian, with respect to the variables t, C2, . . . , Cn, does not 
vanish for /3 = 0, t — to, c* = 0. But this Jacobian is the 
determinant 


dxi 

H 

dXi 

dXi 

dt 

dcz 

dcz 

dCn 

dxi 

d.V2 

dxj 

dX2 

dt 

1 

dct 

dcz 

dCn 

dxz 

dXz 

dxz . 

dXz 

dt 

• % » 

dca 

1 

dcz 

dCn 


dXn 

dXn 

dXn 

dt 

dCi 

dcz 

dCn 
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which, when evaluated for ^ = 0, I = ro, c* = 0, becomes 


dpi 

dxi 

dXi 

dxi 

A A & 

dt 

dco 

dc3 

dCn 

dp2 

dX2 j 

dX2 

dX2 

dt 

dCi 

dC3 

OCn 

dp3 

dx3 

dx, 1 

dX3 

dt 

• • • 

dc-i 

^ ♦ 

dc3 

dCrt 

dp„ 

dx„ 

dXn 

dXn 

dt 

dc2 

dc3 

dc„ 


evaluated for ^ = 0, / = ro, c* = 0. The first column is the 
periodic solution dp/dt, which, wo have assumed, occupies the 
first column of the principal matrix solution }’{(). Thus, the 
pertinent Jacobian vanishes if (and only if) 



for t — To and c* = 5 = 0. Clearly, this is equivalent to the 
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vanishing of the determinant factor in (22) for X = 1. But this 
is impossible since X = 1 is a simple characteristic multiplier of 
(20). Hence for each |/3| sufficiently small, (23) possesses a 
(unique) solution [t(/9), with 


lim tO) = TO and Um c*(fi) = 0 

p-*o p-»o 

The corresponding solution x{t,0) = of (19) is periodic 

with period r(/3) and (from the general continuity theorem of 
Chap. 3) lim x(<,/3) = lim x(t,0,c*(fi)) = p{t), uniformly on each 

fi -,0 fi -,0 

finite interval for i, as stated. 

In analogy \vith the nonautonomous case, it follows immedi¬ 
ately that if the number one appears as a simple characteristic 
multiplier of (20) and if each of the remaining n — 1 characteris¬ 
tic multipliers is less than one in absolute value, then for each 
1/3| sufficiently small, the periodic solution x(i,/3) = x(<,/3,c*0)) is 
asymptotically orbitally stable. 

EXERCISES 

1. Referring to characteristic exponents, (in lieu of character¬ 
istic multipliers), rephrase Theorem 3 and the result following 
the proof of Theorem 3. 

2. Explain and prove the result following the proof of Theorem 

3. 

3. Explain in detail the role of the implicit function theorem 
in the proof of Theorem 3. 

4. State and prove a result analogous to Theorem 3 for analyt¬ 
ical systems. Explain why the relevant period t(/3) is necessarily 
analytic in /?. Discuss the relationship between this and the 
Poincar^ expansion theorem in Chap. 3. 

5. Construct an example illustrating Theorem 3. 
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4 . Periodic Solutions of Autonomous 
Quasi-harmonic Equations 


Theorem 3 is not applicable to the important quasi-harmonic 
system 

^ + x = (24) 


As in the nonautonomous case, we rephrase (24) as a pair of 
equivalent integral equations, 


j(0 

dz{i) 

di 


= a cos i 6 sin f 4- /3 j sin {t — s) f ^ . 


ds 


= —a sin t b cos t 


(25) 


: 


4 /3 / cos ({ - s) f { X, -r 


(x, ,h 


However, for 0 9 ^ 0, one cannot anticipate a periodic solution of 
(24) of period 27r, and so when one imposes the periodicity condi¬ 
tions x(t) = x{0), dx(T)/dt = dx{0)/dl for a period r = 27r 4 
the resulting equations no longer contain just the integral parts. 
We obtain, instead, the equations 

H{r),a,b) = a(cos tj — 1) 4 ^ sin t? 

/ dx \ 

+ ^ I sm (v - s)f f X, 13 j ds 

K{T},a,b) = — a sin »? 4 6 (cos 77 — 1) 

f2w + ti / \ 

4 jS / cos (n - s) / (X, 0] ds 

As they stand, these equations are degenerate for /3 = 0; i.e., 
Eqs. (26) arc satisfied identically in a and 6 for »j = 0 or iden¬ 
tically in 7) for a = 6 = 0. In the forced case, wherein only the 
integral parts appeared, this degeneracy was removed merely 
upon division hy 0 0. This step, though trivial in that case, 
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was essential to the argument. We shall again be able to remove 
the degeneracy here in an analogous, but less trivial, fashion. 

It will be sufficient to exhibit solutions of (26) in which a = 0 
and jj = jSTji. Thus we consider the system 


H(0riiyO,b) = H(r}i,b) = b sin /3tji 

/*2»+en. 

H- /5 / sin (|3i7i - s) / 
^^03711,0,6) = = 6(cos^77i — 1) 

+ / cos (iStji - s) f 






Now upon division by /3 5 ^ 0, there results the equivalent system 


+ / Sin 


i 


in {0711 - s) f 0^ds = 0 




/ dx \ 

I cos - s) / f X, (3 j ds = 0 


(28) 


where Li and L 2 denote terms of no consequence in the following. 
For 0 = 0, the second equation in (28) imposes a requirement 
upon the corresponding values of 6 = bo. Thus, any bifurcation 
amplitude | 6 o| must necessarily satisfy the equation 

$( 6 o) = [q cos s/( 6 o sin s, bo cos s, 0) ds — 0 (29) 


If in addition bo ^ 0, then the first equation of (28) yields, for 

0 = 0 , 

1 

Vi = 4'{bo) = j- I sin s f{bo sin s, bo cos s, 0 ) ds (30) 

Oo Jo 

Thus for 0 = 0, the system (28) possesses the solution b = bo, 
m — 'Pibo), provided bo is a nonzero real root of (29). Further, 
if the Jacobian, with respect to the pair ( 6 ,»;i), of the left-hand 
members in (28) does not vanish for 0 = 0, b = bo, m = 'Pibo), 
then for each |/3[ sufficiently small there exists a (unique) con¬ 
tinuous solution [ 6 ( 0 ), i 7 i 03)1 of (28) satisfying lim 6 (^) = 60 and 

fi ->0 

lim 1 J 1 OS) = ^( 60 ). The corresponding solution of (24) is peri- 
^0 
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odic with period t = 27r + |6t/i(j3) and amplitude [ 6 ( 0 )|. But 
with /3 = 0, the left-hand members in (28) reduce to the pair. 


and 


bm - P sin sf{b sin s, 6 cos 5 , 0 ) ds 

f 

^ cos sf{b sin s, b cos 5 , 0) ds 


so that the Jacobian in question is merely the determinant 



Vi — ^(ho) — 6o^'(6o) ^>0 

4>'(6o) 0 


-bc'P'ibo) 


Thus if 60 5 ^ 0 is a simple (real) root of (29), then | 6 o| is neces¬ 
sarily a bifurcation amplitude for a continuous family of periodic 



Figure 3 


solutions of (24). Each bifurcation amplitude | 6 o| is a root 
(whether simple or not) of (29). Note that if 60 is a root of (29), 
so also is “ 60 . Let us suppose further that (29) possesses only 
isolated roots. Then in the phase plane, the periodic solutions 
(periodic orbits) for small |^| form a family of concentric ovals 
enclosing the origin (see Fig. 3). Each oval approximates the 
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generating solution corresponding to a bifurcation amplitude 
|6o|. The latter, of course, is the circle x* + t/* = and is 
called a generating circle. The stability (orbital stability) of the 
periodic orbit is reflected in the sign of the function 

/ ^2‘t 

cos s/(6 sin s, 6 cos s, 0) ds 


for b lying between the bifurcation amplitudes. In fact, if a 
solution x(/) of (24) crosses the positive y axis for y = b, then 
the next crossing, after a time lapse equal to 2 ir + fiiji, where 
satisfies the first equation in (27), will occur at a point y = 6i, 
where 6i — 6 = K{rji,b) is the left-hand member of the second 
equation in (27). Except for the factor 0, the latter is also the 
left-hand member of the second equation in (28). Hence 



- I + fi'L, + 


L 




cos (/3 j7 



For \0\ sufficiently small, the sign of the right-hand member of 
(31) will be that of ^34>(6). The change in the y intercept then 
has the same sign as /34‘(6). If ^^(b) is negative in a semi¬ 
neighborhood 6 > 6o of a bifurcation amplitude bo > 0, then the 
neighboring exterior trajectories spiral toward the corresponding 
periodic orbit. If ^4»(fc) is positive in a semineighborhood b > bo, 
then the neighboring exterior trajectories spiral away from the 
periodic orbit. Analogous statements may be made for the 
neighboring interior trajectories. In particular, if 6o > 0 is a 
bifurcation amplitude and 0 ^'(bo) < 0, then the corresponding 
periodic orbit is asymptotically orbitally stable. If /S4>'(6o) > 0, 
then the periodic orbit is unstable. The technique employed 
here is called the PoincarS method of secli(ms. We have, in effect, 
reduced the investigation to geometric questions relating to the 
successive points of intersection of a phase-plane trajectory w'ith 
the positive y axis. The latter is called a manifold of sections. 
A periodic solution emerges as a fixed point of this manifold 
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while its orbital stability characteristics are reflected in the 
“motion” of neighboring points of the manifold. 

EXERCISES 

1. Apply the method of this section to the van der Pol equa¬ 
tion, d^xldf^ "h ti{z^ — \)dx/dt + x = 0, with I^[ small. In par¬ 
ticular, determine the bifurcation amplitudes and their associ¬ 
ated stability characteristics. 

2. State and prove results, analogous to those obtained in this 
section, for analytical systems. Explain wliy the relevant period 
2ir -f 7/(/?) is analytic in /3. Discuss the relationship between 
this and the Poincar^ expansion theorem in Chap. 3. In par¬ 
ticular, discuss the relevance of Example 3 (and related exercises) 
of Chap. 3. 

3. In the notation of this section, explain why the solution 
variable iji of (27) is given approximately by iji = \p{b), for [/3| 
small. Use this to discuss the periods of the periodic solutions of 
(24) and the relative phases of neighboring .solutiotKs. Explain 
the significance of the roots of ^(6) = 0. 

4. In the notation of this section, prove that a periodic orbit, 
corresponding to a bifurcation amplitude ho > 0, is asymptot¬ 
ically orbitally stable if /34>'(6o) < 0. 



Chapter 8 


A GENERAL ASYMPTOTIC METHOD 


1. Introductian 

The theorems of the previous two chapters have focused atten¬ 
tion on periodic solutions. This is altogether appropriate since 
in dynamical s^'stems periodic motion is certainly the first order 
of business. Still, the theorems offer scarcely a hint as to the 
nature of the periodic motion and provide essentially nothing 
at all for practical applications. It is small comfort to an engi¬ 
neer, for example, to know that the steady-state response, what¬ 
ever its natxire, is imbedded within a general family of responses, 
none of which arc available to him. However, fortified by the 
assurance that a periodic solution exists, it is often possible to 
uncover sonic of its more salient properties. Very often, a few 
teinis ot its fourier expansion may be identified and this may be 
sufficient for many purposes. Some of the "theoretical” results 
of the previoiLs chapters may indicate the stability characteris¬ 
tics, although more often than not, for rigorous conclusions one 
w ill be forced to look elsewhere. A theory of aperiodic solutions 
is practically nonexistent. 

In this final chapter, therefore, we shall illustrate a general 
perturbational method for the study of linear and nonlinear 
oscillations. The method satisfies the demand in applied mathe¬ 
matics for a sound and versatile technique and at the same time 

220 
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the requirement of basic simplicity for practical applications. 
These features are illustrated in a study of the throe mo.st 
poignant and historically prominent examples from the theory 
of oscillations. 

The procedure is to develop, essentially by an iterative proces.s 
the solution in the form of one or more asymptotic series in a 
perturbation parameter. This i.< merely a formal procedure and 
nothing is claimed, in regard to convergence, for the asymptotic 
series. However, the essential properties of a solution for values 
of the perturbation parameter with small magnitude are reflected 
in the asymptotic form, and in most applications the asymptotic 
series itself may be regarded as a solution. There are instances, 
of course, wherein the asymptotic series actually converges and 
hence is an exact perturbational solution. 

2. The Mathiev Equation 

Consider the Mathicu etpiation 

+ w-u = tu cos t (1) 

at- 

For € = 0, the solutions of (1) are the uniformly bounded, simple 
harmonic functions of period 27r/w. For t 0, one would expect 
the solutions to be somewhat similar. To what extent thi-s expec¬ 
tation is fulfilled is the subject of the present investigation. 
The periodic solutions of (1) of period 27r or 47r are called 
functions and completely characterize the stability properties of 
(1). However, only for very special values of w* and t do such 
periodic solutions exist. In general, the solutions of (1) are 
either almost periodic, or diverging or decaying oscillations. We 
shall express a general perturbational solution of (1) in the form 
of an asymptotic series 

U = A cos (wt — ^) + + <**^3 + ' • ■ + (2) 
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where each of A, 9, ui, is, in general, a variable. The 

first term of the expansion represents the principal part of the 
solution and, with A and 9 each variable, suggests a variation of 
parameters treatment. On the other hand, the additive terms 
in powers of the parameter € suggest, and provide for, an expan¬ 
sion-type perturbational treatment. The following procedure 
incorporates what are probably the principal advantages of the 
two classical techniques and, at the same time, avoids what are 
probably the principal shortcomings of each. 

If (2) is substituted in (1), there results 




+ 


d^-A 

dt^ 


- - ©■] 


cos {ojt — 9) 


+ 


-H € 


dA , - dA d9 . . d'^9~\ . , , 

+ 2 — — + .A -772 sin (wi — ^) 


^ —2c<; 

+'“ ( dr- 

, y I dhiff , \ 6-4 

+<-dF + “'“V = T 


dt dl ' dt 
21 d^uz 


-b 0} 


c 


■W2^ 


+ 


cos [(a> + 1)< — 


+ cos [(w — 1)( — e) -f- cos i + «*U 2 cos < 4- • ' 

H- cos t 


(3) 


For 6 = 0, (3) implies that each of 9 and A is a constant, which, 
of course, is as it should be. The explicit first-order terms (in e) 
in (3) suggest that ?<i should satisfy the equation 

dl-^ + ^ H- l)i — 0] + 4 


Indeed, tliis is appropriate provided the frequencies on the right 
do not produce resonance or near resonance in Ui. We may 
assume that w is positive throughout and so only the second term 
on the right in (4) can produce resonance or near resonance. 
For CO = ^2 ^md 9 constant, this term is resonant and every 
solution of (4) is unbounded. It is therefore necessary to remove 
the term. It may be interpreted as a fundamental harmonic 
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term in (3). In fact, this term leads to two harmonics (with 

= y2), 

I cos [^ - I - 9 j = cos [l-it -9 + 29] 

= ^ COS 20 cos [ 3 - 2 / — 0] 

- ~ sin 20 sin U 


Thus, for 
in (3), 


w = 3-2 've obtain from the fundamental 


dt A dr- / 

1 d .4 2 d.-l de d^-d 

A dt A dt dt dr 


^ cos 20 
~ sin 20 


harmonics 



and (4) is replaced by 


dr 


+ 



cos (3^/ — 0 ) 



Fortunately, it is not necessary to treat the variational equa¬ 
tions (5) precisely, but rather, it is sufTicicnt at this point to 
obtain solutions correct to /irsi order in e. Hence we reduce ( 5 ) 
to the system 


d/ 
1 dA 
A dt 


^ cos 20 
i sin 20 


(7) 

( 8 ) 


merely by dropping the terms d\A/dr, (de/diy-, (dA 'dtdO/dt), 
and dHfdr. According to (7) and ( 8 ), each of the omitted terms 
will be of second order in €. From the first equation, (7), we sec 
that < —» CO as cos 20 ^ 0. Using (7), ( 8 ) may bo expressed 
in the differential form 


dA 

A 


sin 20 
cos 20 


rf 0 = ^ 3 ^d(In cos ] 20 |) 



224 NONLINEAR DIFFERENTIAL EQUATIONS 


Hence if cos 20 > 0 initially, then 

A = / cos 200 
Ao V cos 20 

and if cos 20 < 0 initially, then 

A _ / cos 20 
Ad Vcos 200 




where A a and 0o may be regarded as initial values of A and 0 
respectively. In the former case, |.4l—» « as t—* «, while in 
the latter case, -4 —* 0 as t—* <». Thus for w = }- 2 , have 
solutions which arc diverging oscillations and solutions which 
are decaying oscillations. If cos 20© = 0, then 0 s 0o and 
A = -loc**''*, with the sign being that of sin 20o. 

On the other hand, for appreciably different from the 
solution to fir.st order in c becomes 


It = .4 cos {ut - 0) — ij 

+ 2l‘2^^\) - 1)( - 0] (11) 

whore each of A and 0 is a constant. It is of interest to consider 
how (11) degenerates as w —» ^ o and how the diverging and decay¬ 
ing (l^(•illat ions emerge. 

I'or near ' •>, we may write the troublesome term in (4) in the 
form 


cos [fw — 1)/ — 0] = ^ cos [(1 — 2u)t 20] cos (oil — 0) 

- ^ sin [(1 - 2aj)i + 20] sin (wf - 0) 


and, a.-^ in the exact resonance case, shift these terms to the funda¬ 
mental harmonic terms in (3). If we assume that (1 — 2u3) is 
small of order e, we may again reduce the full variational equa- 
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tions and obtain the system 


dt 


€ 

— COS 

4a) 



— 20 ] 


1 dA 
A dt 


= sin {(1 - 2u))t + 20j 
4u) 


We introduce the auxiliary variable 


4» 

and these become 

= (1 - 2a,)/ + 20 

(12) 

di^ 



dt 

= 1 — 2uJ + COS 4> 

(13) 

1 dA 

€ 

(14) 

A dt 

= — Sin <!> 

4a) 


The behavior of a solution of this system depends upon the rela¬ 
tive sizes of the quantities jl — 2w| and |€|/2 uj. For |l — 2«| > 
|cj/2w, d^/di = 1 — 2a) -f- (e/2a)) cos never vanishes and ‘h is 
monotone with I, while for jl — 2w\ < |f|/2a), di> <!( necessarily 
vanishes. In the former case, all solutions of (14) are bounded, 
while in the latter case, there are always unbouinK-d solutions. 
In fact, when (13) is used, (14) may be expressed in tlie dilTcrcn- 
tial form 


dA ^ _e/4w sin d4» 

A 1 — 2ai + €/2a) cos 


T I <1 (in 


1 - 2a, + 


eos 


Jai 



and so either 

A _ /l — 2aj -}- t/2a, COS 4>o 

/1 0 ~ \ 1 — 2a, + e/2a, COS 

QP ^ / 1 ~ 2a, + e/2a, COS 

Ao \ 1 — 2a, + €/2a, cos ‘I>o 


depending upon the initial sign of the quantity 1 — 2u, 4- 
c/2a, cos il,. The locus 


|1 - 2.1 = M 


(15) 
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therefore, separates these radically different behaviors. In the 
eto plane, (15) depicts certain curves, to one side of which the 
parameter pairs (f,a)) always correspond to bounded solutions of 
(1) and to the other side of which the parameter pairs (e,a)) 
correspond to both bounded and unbounded solutions of (1). 
These curves are illustrated in Fig. 1, It is customary to plot 
\t\ versus rather than c versus w, and we follow this custom. 
It is just along these curves that the periodic solutions, cor- 



0.25 0.50 1.00 w* 

Figure 1 


responding to the Mathieu functions, emerge. Typically, the 
curves themselves are found by ascribing to them this property, 
i.e., the property of admitting periodic (with period 27r or 47r) 
solutions of (1). Here we note that Eqs. (13) and (14) become 

^ ^ 1 ± 1 + cos 4'] (16) 

and -1 ^ sin (17) 

A at 4w 

The periodic solutions correspond to one of the trivial (singular) 
solutions of the system (1C), (17), say s x, with the plus sign 
in (16), or s 0, with the minus sign in (16). In such a case, A 
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is constant, and from (12) we obtain 

The frequency of the fundamental harmonic in (2), therefore, is 
given by 

dQ , 1 - 2aj 1 

“ ~ 57 - = 2 


and the least period is Of course, there are other (nontrivial) 
solutions of the system (16), (17), corresponding to other initial 
values of For these, (17) may be written 


dA 

A 


1 

2 


sin 

± 1 + cos 4> 



and so 

or 


Aa 

Ao 


± 1 + cos 4>u 
± 1 + cos ^ 

± 1 -{- cos 4> 
± 1 + cos 4>o 


+ ^ d(ln 1 + 1 + cos ^1) 
for +1 + cos > 0 
for +1 + cos <l>o < 0 


Thus, for |1 - 2i^\ = |eI/2 w, there are bounded and unbounded 
nonperiodic solutions in addition to the periodic ones. 

Higher-order solutions may be obtained for both the resonant 
and nonresonant cases. We shall consider only the latter here. 
Thus we now assume that the parameter pair (<,u)) is appreciably 
away from the critical curves defined by (15). As we shall 
encounter other critical curves, the curves defined by (15) will 
be referred to as the first set of critical curves. If the first-order 
solution (11) is substituted in (3), we obtain the second-order 
variational equations (reduced from the full variational equations) 


dt 
1 dA 



(18) 


A dt 
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and the second-order perturbational equation 

+ 4(2^) 


Again, if resonance is not a problem in (19), we have immedi¬ 
ately the second-order (almost periodic) solution 


u = A cos {<jit — 6) — 


A 


2(2w -i- 1) 


cos [(w -h 1)< — 


+ 


+ 


■A 


2(2w - 1) 


cos [(a) — l)i — 


16(2w -I- l)(a) + 1) 


where 


16(2o> - l){o> - 1) 

€H 


cos [(a> -h 2)t — 6] 


cos [(w - 2)t - d] (20) 


5 = do + 


4«(4a)5 - 1) 


and A is constant. For a? near 1, however, the last term on the 
right in (20) degenerates, and we must remove the offending 
term in (19). We write 


4(2a) - 1) 


cos [(o) — 2)/ — d] 


A 


4(2a) - 1) 


cos [2d -i- 2(1 — <!))«} cos (a3< — d) 


sin [2d -H 2(1 — o))t] sin (a)i — d) 


4(2u) - 1) 


and introduce these in (3) as fundamental harmonics. Then the 
system (18) is modified according to 


dt 

dA 

dt 


1) + 8.d - ' i) ~ 

8.(4,^ - 1) I®" + 
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In terms of the auxiliary variable 4> = 2^ -f- 2(1 — w)/, these 
become 



+ 2(1 - u,) + cos 4. (21) 

8..(4J'- 1) * ^22) 



Figure 2 


Thus we encounter a second set of critical curves near w = 1. 
These are determined by the equation 



and are referred to as the second set of critical curves (see Fig. 2). 
For 
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the solutions of (22) are given as either 


A _ ai H- bi cos 
Ao ™ V fli + cos 

Qi bi cos 
ai -h 6i cos #0 

with 



(24) 

(25) 


2 _ tan 4»o/2 ^/ai^ — + (oi + 5i) tan (V ai^ — f/2) 
2 — (oi — 6i) tan ^o/2 tan (■%/Oi* — 6i“ (/2) 

(26) 

for |ai| > |6i[, or 


, 4> 

tan TT = 


fli + 6i 


2 \/6i* — Oi* 

(Vti® — tan 4 »o/ 2 + O i + 5i) ex p (V^fei* — Oi* t) 
_ + — Oi® tan $o/2 — Oi — 6i 

(\/bi^ - a,2 tan 4>o/2 + O i + 6i) ex p (\/5i* — 0 

— — Oi* tan ^o/2 + ai + 6i 


(27) 


for |ai| < \bi\, where 


and 



2u>(4«* - 1) 


4aj(2« — 1) 


+ 2(1 - «) 


Along the critical curves (23), periodic solutions correspond to 
the trivial (singular) solutions of the system 


d4> 

Tt 

dA 

dt 


M2^^(±l + cos 4>) 

4w(2a. - 1) ^ 


and there are other nonperiodic bounded and unbounded solu- 
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tions given by (24) and (25). The least period of the periodic 

solutions in this case is 27r since 0 = d^/dl = 2de/dt + 2(1 — a;) 

and hence cu - dQ/dt = 1. Thus these periodic solutions also 
correspond to Mathieu functions. 

Considering only the nonresonant case (20), the third-order 
variational equations become 


dt 

dA 

dt 




and the third-order perturbational equation becomes 


d^U : 

di^' 




(w+l).l 

4aj(2u) + l){-4a)2 - 1) 

“ M2(J - I)(4a,-' - f) “ 1)^-0] 

:}2T 2 T +1)(a, -H 1) 

"*■ ^ 2a.-Hl)(a.-H) 

32(2c.-1)(a>- 1) 

:i2(2w - l)(a; - n ~ 


(29) 


It should be pointed out here that (29) incorporates terms 
(the first two on the right) which correct, to order e^, tiic term 
i(d^Ui/dt^ -f w*u,) appearing on the left in (3). For hi does not 
satisfy (4) to order unless dd/dt is zero to order But with w 
appreciably different from 1, dO/di is given by (18) to order 
and is not zero. If w is also appreciably different from 3^, no 
resonance occurs in (29) and the third-order solution is given by 


u — A cos {ut — ^) + e«i + c*ii 2 + 
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with 


e] (30) 


= 32(20, - l)(a, - l)(2a) - 1) 

“ 32(2a, + lyiu, + 1) 

“ 96(2o, + l)(a, + l)(2o, + 3) ~ 

- 40.(20, - lt^(4o,^ - 1) 

“ 4o,(2o, + 1)"^(4o,“- -■ 1) 

96(20, - l)(o,^- l)(2o, - 3) ~ 

tH 

where ^ = 00 + . .. . -^ 

4o,(4o,* — 1) 

and A is constant. However, we encounter a third set of critical 
curves near o. == ^, along which the last term on the right in (30) 
degenerates. The offending term (last term on the right) in 
(29) is removed and expressed in terms of the fundamentals as 
before. Equations (28) are then modified according to 

do 3 

-T. ~ , (. o -rr + TTlo -TT7-Tn + (3 — 2o,)fl 

(it 4o,(4o,- -* 1) o4o,(2o, — l)(o, — 1) 


\ dA _ €3 

A di ~ G4«(2o, - l)(o, - 1) 


sin [20 + (3 - 2o,)f] 


With 4> = 20 + (3 — 2o,)/, these become 


d4> 
dt 
1 dA 
A dt 


e- 

^(-io.--'- 1) + + 32o,(2o,- l)(o, 


cos^ 


(31) 


(54(20, - I)(o, - 1) 


sin 


The third set of critical curves are defined by the equation 


2o,(4o,2 - 1) + 2o,) - - l)(a, - l)o, 


(see Fig. 3). For 


2o,(4o,’- - 1) + ” 2o,) 5^ 32a,(2o, - l)(o, -T) 



Critical curves 

- Asymptotic theory indicate 

stable regions 

- Exact (Floquet) theory 
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Eqs. (31) lead to either 

a% + ht cos $0 
02 + 62 cos 4 > 
cij + b2 cos 
0-2 “h i>2 cos 4 >o 



(33) 

(34) 


with 4» given by (26) or (27), in which ai and 61 have been replaced 
throughout by 


and 




2a>(2w + l)(2a, - 1) 

32w(2w + 1)(« - 1) 


respectively. Along the critical curves (32), periodic solutions 
correspond to trivial solutions, and again there are nonperiodic 
bounded and unbounded solutions given by (33) and (34). In 
this case we find that the fundamental frequency of the periodic 
solutions is given by w — dd/dt = w — (2w — 3)/2 = ^ 2 » so that 
the least period is 4ir/3. Of course, 47 r is also a period, and hence 
these periodic solutions correspond to Mathieu functions. 

The process may be continued to obtain higher-order approxi¬ 
mations without essential modifications and, at each step, a new 
segment of the resonance pattern is revealed. However, the 
labor involved soon becomes excessive. The stability properties 
of the Mathieu equation (1), as inferred from the asymptotic 
solution (2), are indicated in Fig. 3. The critical curves separate 
the resonant and nonresonant cases of (1). Though the asymp¬ 
totic character of ( 2 ) restricts any application to small [tj, the 
over-all qualitative characteristics of the stability regions in 
Fig. 3 are remarkably similar to those produced by the exact 
(Floquet) theory. Well-known amplitude and frequency modu¬ 
lations in the principal part of the solution (for parameter pairs 
(€,a>) near, but off the critical curves) are here reflected in the 
various closed form expressions for A and 4». 
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EXERCISES 

1. Explain the occurrence of periodic solutions of (1) for 
parameter pairs (<,u>) “everywhere dense” in the shaded (stable) 
regions of the ew plane in Fig. 3. The periods 2Tr and 4^- do not, 
however, occur. 

2. Explain in detail the relationship between the resonant and 
nonresonant solutions obtained by the asymptotic method. In 
particular, explain how they merge as the point ((,ui) moves 
away from the critical curves. What modifications need to be 
made in the “reduction” of the variational equations in order 
that the resonant and nonresonant solutions merge? 

3. Apply the traditional method of “variation of parameters” 
to a study of (1). Assume a solution of the form 

u = A cos {(x/t — 6) dn/di = — a>.4 sin (uj/ — 0) 

in which each of A and 0 is a variable. Show that the equa¬ 
tions of variation for A and 0 assume the forms 

^ cos ( -h cos [(2c. - 1)( - 201 

+ cos[(2u3 + 1)/ - 20] 

4a;* 

7 ^ = - 2 ' sin l( 2 a, - 1 )( - 201 - 5 “ '-"I 

Note that this procedure is perfectly general and ( 1 ) is equivalent 
to the above system. The motivation behind the “variation 
of parameters” method is the expectation that a solution of ( 1 ) 
for e ^ 0 (but for |(| small) is very nearly a simple harmonic 
of the form A cos {wt — 0), which it would be if e = 0. The 
perturbations induced by the e term in ( 1 ) arc then expected 
to be reflected in “slow” changes of the amplitude A and phase 0 
of the near harmonic. This expectation is borne out by the form 
of the above system since the right-hand members arc each 
proportional to €. However, the integration of this system is 
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not a simple matter. Using the method of “averaging,” one 
replaces the right-hand members by their mean values with 
respect to t (on the premise that the rapid oscillations do not 
contribute to the slow changes which occur in 6 and A). This 
reduces each of the right-hand members to zero (the zero func¬ 
tion) provided « 5 ^ 3^. This is appropriate so long as |2a> — 1| 
is not small. When it is, the corresponding terms no longer 
represent rapid oscillations. A little insight into the matter is 
obtained if one first introduces the auxiliary variable 

4> = (1 - 2iS)t -H 2$ 

Show that the system then becomes 

1 — 2t«) + -4 cos i -f ^ cos ^ cos {2t — $) 

2ur 2w* 

^ sin 0 + I sin {2t — 0 ) 

Unless w is nearly 0 does not vary slowly. But if w h nearly 
3^, 0 not only varies slowly, but the method of averaging yields 
the nontrivial approximations 

d0 
~dt 

LiA 

A dt 

This is the system (13), (14). Using the method of averaging, 
show how the other critical (resonance) cases arise in the 
variation of parameters version. 

3. The Free Oscillations of the van der Pol Equation 

Consider the van der Pol equation 


— 1 — 2(a -f- 


2a,* 


cos 0 


= 2 sin 4 . 


d0 
dt 
1 dA 
A dt 


— + X = ufl - arn - 


(35) 
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for ^ > 0 and an asymptotic solution of the form 


X — A cos (/ — ff) + fiXi + fi^Xz + • ' • + (36) 


where each of /I, 0, jj, . . , , zx is a variable. The principal 
part of the solution is chosen as a near harmonic, so as to reflect 
the basic characteristics of the solution for small m- For m = 0, 
of course, the amplitude -1 and phase 6 are each constant. When 
(36) is substituted into (35), one obtains the equation 




+ 


d^A 


I 


- ^ ©’] 


cos (/ — 0) 


_L I 4 _L 9 9 

+ <¥“-7/7 


sin (f — 0) 


+ M 


(‘w + + ■ ■ • + <<'■ + ^,v) 

= - ^ ^(4 - A^‘) sin (( - 0) + ^ ..p sin 3(/ - 0) + O(m-) 

(37) 


where 0 (m*) denotes terms of order #4*, . For m = 0, (37) 

implies, appropriately, that each of A and 0 is a constant. Con¬ 
sidering only terms through first order in m, arc led to the 
variational equations 



dM , /ddy 

Up - ■'* U; 

dA dd d.l 
^~dJ 





and the perturbational equation 

^'+ X, = - 9) (39) 

Again it is sufficient to obtain solutions accurate to first order 
(in /i), and so we consider, instead of (38), 



dt 




(40) 
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Thus to first order in n, 6 remains constant and A is determined 
immediately as 



4 

1 + (4/i4o* - l)e-^ 



where denotes an arbitrary (nontrivial) initial value for A\ 
In every case, ^4*—> 4 (i.e. |i4| —> 2) as < —> To first order, 
(39) is satisfied by xi = ~(A^/32) sin 3(i — 6) and the first- 
order solution becomes 

X = A cos ~ ~ ^ sin 3(< — 6) (42) 


with 0 constant and A given by (41). When (42) is used, the 
second-order terms on the right in (37) are then determined 
from the right-hand member of (35). It is also necessary to 
evaluate the term n{d'Xi/dl^ -|- Xi) on the left in (37), to second 
order in n. Considering terms through second order in n, we 
are led to the variational equations 


- . d0 , dM , (dB\ 

■ d^d . „ dA dd dA 

W ~^di ~dt 


128 

+ 3A>)(4 - .!») (43) 

A^) 


and the perturbational equation 


d-Xi 

W 


4- X2 = 


128 


4* cos — 0) + 


A\A^ -h 8) 
12’8 


cos 3(i — 0) 


Using the first-order solution (40), we may reduce the variational 
equations (43) to the forms 


dt 

dA 

dt 


^'4^4. Jfl. 

256 128 


(4 - 3A»)(4 - A*) 


(4 - A') 



which retain accuracy to second order in n. The second of these 
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is as in (40), and hence the amplitude A is given correctly to 
second order in m by (41). The first equation in (44) may be 
expressed in the form 



(4 - 3.1-) (4 - .1=) 




and thence, upon using the second, in the form 




16 


32A 


Thus 


e = 







with ^0 constant. The perturbational term .r.. is determined as 

= - 30I2 ~ 

and the second-order solution becomes 

j 3 

X = A cos {t ^ 6) — fi — sin 3(f — 6) 

- >2 cos 5{( - 0) - + 8) “S 3(( - 0) 

with the phase 6 given by (45) and the amplitude -4 by (41). 
Higher-order solutions can, of course, be obtained by straight¬ 
forward, though increasingly more tedious, calculations. One 
observes that no resonance phenomena have been (or will be) 

encountered. 


KXERCISKS 

1. Plot the principal part of a solution (36) for variou.s initial 

amplitudes Ac. 

2. If the initial amplitude Ac is 2, (36) becomes an expansion 
of the periodic solution of (35). Show that in this special case, 
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the present method is equivalent to the Poincard expansion pro¬ 
cedure introduced in Chap. 3. In particular, show that (45) 
yields the second-order correction to the fundamental frequency 
of the periodic solution. Explain how (45) defines an “asymp¬ 
totic phase” for each nonperiodic (transient) solution. 

3. Obtain the third-order solution (36). Note, in particular, 
that the first equation in (44) is valid to order but that the 
second now requires modification. 

4. Use the variation of parameters method and subsequently 
the method of averaging in a study of the solutions of (35). 


4. The Forced Oscillations of the van der Pol Equation 


We first consider the equation 

-b X = /i(l ~ x^)-~ nk cos \t (46) 

where each of k and X > 0 is a fixed constant and the constant 

M > 0 is small. Because of the factor fi, the forcing function in 

(46) is “soft,” and so wc here anticipate an asjmiptotic solution 

in the form 


X — A cos (( — 0) -b fixi "b fi~Xz 4* ■ * • + fx^xa (47) 

with a principal part reflecting the basic characteristics of the free 
oscillations. The “hard” forced case will be considered sub¬ 
sequently. When (47) is substituted into (46), one obtains the 
equation 


24 ^ ^ 

dt ^ dt^ 


- ^ (?)■] 


cos (/ - e) 


+ \A^ + 2^^-2'^ 


dt dt 


dt 


j sin (f — 


e) 


•bM 




= [ik 


cos \t 


- ^ 4(4 - 4=) sin {t- e)-\-~A^ sin Z{t - 0) + 0(m=*) (48) 
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If the input frequency X is appreciably different from unity, then 
we obtain for the first-order variational equations 


di 

dA 

dl 


= ^A{A- A^) 


and for the first-order perturbational equation 


= — sin 3(/ — 6) k cos X/ 
at^ 4 


(49) 


From these we obtain the first-order solution 


X = A cos {t - ^ ^ sin 3(t - tf) + t‘OS \t (50) 

«5^ i A ** 


with $ constant and .1 given by (41). This solution contains 
both the forced and natural freciuencics supcrimpo.^ed as though 
the system Nvere linear. Since |-l| approachc.s 2, the natural 
response can be expected to dominate. This is not an unexpected 
result, of course, in view of the fact that (40) is “nearly” linear, 
and the forcing function is soft. However, as the forcing fre¬ 
quency X approaches unity, the character of the solution i.< 
modified radically and a somewhat unexpected phenomenon 
takes place. As X approaches unity, the forced re.'^ponse becomes 
more significant (this is already clear in (50)| but instead ot a 
persistence of both the natural and the forced resj)onscs, the 
former becomes entrained by the latter. The result is a synchro¬ 
nization of output at the input frequency. Put another way, the 
soft forcing function in (4G) commands a response at the input 
frequency only under a resonant condition with an input fre¬ 
quency nearly equal to the natural frcciuency. Expressed in 
this way, the entrainment phenomenon is perhaps not quite so 

unexpected. 
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For X nearly unity, we remove the nearly resonant term in (49), 
express it in the form 


fik cos \t = nk cos [t{\ — 1) + 0)] cos {t — 0) 

— tik sin [i(X — 1) + fl] sin {t — 0) 


and combine the result with the other fundamental harmonics. 
The variational equations are then modified according to 


^ ^ = y cos [/(X - 1) + 0] 

^ g ^(4 - A2) + sin [t{\ - 1) + 0] 



and the perturbational equation becomes merely (49) with the 
nearly resonant term removed. The study of the variational sys¬ 
tem (51) is facilitated by introducing the rectangular coordinates 


o = A cos [<(X - 1) + 0] 
6 = A sin [i(X — 1) + 0] 



in lieu of the polar-type coordinates (A,0). The a6 plane is 
referred to as the van der Pol plane. In terms of the rectangular 
van der Pol coordinates (a,6), the system (51) becomes 


^ = I (4 - A"-)a + (1 - \)b 



where A^ - + 6=. A critical point (ao,6o) of the system (53) 

satisfies the algebraic equations 


g (4 - Ao')ao+ (1 - X)6o = 0 

(1 - X)ao - g(4 - Ao2)6o = 


( 54 ) 
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which may also be expressed in the forms 




_ (A-/2)(l - X) V 

(A-,'1G)(4 - .-lo*) 

^G4(-i - .-lo=)* + [(1 - X)/mP 



Upon squaring and adding in (54), we obtain also the useful 
relation 



For each nonnegative root of (50), Eqs. (55) define a critical 
point (ao,6o) of (53). The nature of a critical point is generally 
reflected in the linear approximation near that critical point. 
This is the linear system with the coefficient matrix (Jacobian 
matrix with respect to (a,6) of the right-hand members of (53) 
evaluated at (ao,5o)] 


(4 - /lo* - 2oo*) 1 - X - 'flofco 

8 4 

— 1 + X — - ao6o ^ (4 — .4o* — 26o-) 

4 8 

The determinant is 

A = [>>64(4 - Ao')(4 - 3.4o’) + (^^)’] 

and the trace is 

n = ^(2 - 

In the variables Ao* and (1 — X)/ai, the locus A = 0 is an ellipse, 
the interior of which corresponds to A < 0. The corresponding 
critical points of (53) arc saddle points. Exterior to the ellipse, 
A > 0, and the eorresponding critical points are stable if > 0 
and unstable if S2 < 0. The locus Q = 0 is the line ylo* = 2. 
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Figure 4 depicts the complete pattern distinguishing, in addition, 
those regions which correspond to foci and those which correspond 
to nodes. 

Now a critical point (ao,fco) of the variational system (53) cor¬ 
responds to a periodic solution of (46). The amplitude of the 
principal part (to first order in n) is |Ao| and the frequency is 



Figure 4 


[according to (52)] given by 1 - dO/dt = 1 - (1 - X) = X, i.e., 
the impressed frequency. The complete solution (to first order 
in fi) becomes 

X ~ An cos \t — fi 4^ sin 3X( (57) 

The orbital stability characteristics of one of these periodic solu¬ 
tions are the same as the Liapunov stability characteristics of the 
corresponding critical point of (53). 

It is of some interest perhaps to consider the nontrivial solu¬ 
tions of (53). We are not so fortunate in this case as to be able 
to exhibit them in closed form. Hence, we shall be content here 
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with a few observations of a rather general nature and then a 
look at some special cases (see Figs, o, 6. and 7 for illu.'tration.< 
of a few of the possibilities). From (53) we have immediately 


1 

2 dt 



tile h 

T7P 


Thus, for large, dA^/dl is negative, and this means iliat the 
distant solutions in the ab plane are necessarily directed inward 
(see Fig. 5). If we introduce in the ah plane the polar angle ‘l> 
in the usual manner, i.e., a = .4 cos I', b = A sin then accord- 


b 


a 



Figure 5 
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ing to (52), we have - 1) + and so the asymptotic 

solution (47) assumes the form 

X = A cos {\t — 4') + liXi + - • • -f- (58) 

Thus, the deliberate motion in the van der Pol plane given by 
(53) is manifest directly in (58) by slow variations in the ampli- 



Figure 6 


tude A and phase the latter now defined relative to the 
impressed frequency. The above observation implies that all 
nonperiodic solutions exhibit deliberate, possibly somewhat spo¬ 
radic but uniformly bounded, amplitude modulations (see Fig. 6). 
Frequency modulations occur if the corresponding van der Pol 
trajectory persists in encircling the origin of the van der Pol 
plane (see Fig. 7). In such a case, we say that 4> has a secular 
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part (a time-like part). When the quantity [1 — X|/V is rela¬ 
tively large, (50) possesses exactly one positive root .lu'. I nless 
k is also correspondingly large, this one positive root will be .small 
and will lead to a critical point lying in the unstable region of 



Figure 7 


Fig. 4. By the Poincar^-Bcndixson theorem, then, there will 
exist a periodic orbit of (53). It turns out that ea<‘h nontri\ial 
solution of (53) tends to the periodic one (see big. 7). In this 
fashion, the form (58) of the asymptotic solution merges with the 
form (50) for X appreciably different from 1. A discussion of the 
exact correspondence between these two forms is an interesting 
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exercise, which is left to the student. The unique unstable 
critical point encountered here leads to an unstable periodic 
solution of (46) at the impressed frequency X. This theoretically 
interesting (practically, uninteresting) periodic solution was not 
discussed in the nonresonant case of (50) because we more or less 
ignored the trivial variational solution ^ = 0, ^ = const. This 
latter leads to a periodic solution (50) with the leading term 
[fik/{l — X^)] cos XL 

At the other extreme, we have X == 1, and this corresponds to 
the exact linear resonance case in (46). Here, in the nonlinear 
case, we are concerned with those cases represented by the points 
of the i4o* axis in Fig. 4. For k* exceeding *^ 7 , (56) possesses 
exactly one positive root Ao®, and as A'* increases without bound, 
this one root also increases without bound. Thus the unique 
root Ao* will for all large k^ fall within the stable region of Fig. 4. 
The corresponding periodic solution (58) is asymptotically orbit- 
ally stable. In fact, every solution necessarily approaches the 
periodic one. Similar results hold for all X near but not neces¬ 
sarily equal to 1. That is, for all large A*, there exists a unique 
asymptotically orbitally stable periodic solution of (46) with 
frequency X, to which every solution converges. 

We rephrase these results for the “hard" forced case 

^ X = nil “ 2 :*) ^ -H F cos Xt (59) 

In (59), A becomes F/n. For X nearly unity, we may expect 
a unique periodic orbitally stable solution at the impressed 
frequency X and to which every solution converges. For X 
appreciably different from unity, we may expect a unique asymp¬ 
totically orbitally stable solution which exhibits both the natural 
and the impressed frequencies and to which every solution con¬ 
verges, save a single unstable periodic solution at the impressed 
frequency X. One encounters no difficulty in exhibiting these 
results directly. We assume an asymptotic solution wth the 
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principal part 


A cos (t — 0) + 



cos Xi 



which reflects the basic characteristics of the linear “hard’' 
forced case. Then for X appreciably dilTerent from 1, we obtain 
(to first order in ;x) the variational equations 


dt 

dA 

dt 


0 

8 


A2 
4 




2(1 


ft 1 

- X=)^J 



The first-order perturbational equation contains quite a number 
of terms, one of which becomes resonant for X = 1. We shall 
not be concerned with resonance here, however. It is the second 
equation in (61) which is of interest. Of course, it is but a simple 
matter to integrate this equation. We leave this matter as an 
exercise for the student. Excepting the null solution .1' = 0, 
it is clear that every solution .4* cither tends to zero, in the 
event F^/2{1 — X-)* > 1, or tends to 4[1 — /■'-, 2(1 — X-)-], in 
the event FV2(1 — X*)* < 1. In the former circumstance, the 
"natural” response portion of the solution fades out completely, 
so that only the impressed frequency X remains in the steady- 
state oscillation. In the latter circumstance, both the natural 
and impressed frequencies will persist into the steady-slate 
oscillation. Thus, in the hard forced ca.'^'o, the entrainment 
of the natural frequency by the impre.ssed frequency will occur 
throughout a rather wide range of input frequencies X. It 
should be noted that the rapidity with which A* tends to zero 
for FV2(1 — X2)2 > 1 increases markedly with increases in the 
quantity FV2(1 — X^)^ Thus, the rapidity with which the 
natural response portion fades out also increases markedly with 
either increases in the hardness of the forcing function or else 
decreases in the separation of the natural and impressed fre¬ 
quencies. The absolute value of the difTcrence between the 
natural and impressed frequencies is referred to a.s the detuning. 
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EXERCISES 

1. Assume a solution of (46) in the form 

dx 

X = a cos Xi + 6 sin Xi “jr = ”■ sin Xt + \b cos \t 

at 

where each of a and 6 is a variable. Derive the variation of 
parameters equivalent of (46) in terms of a and b. Use the 
method of averaging (over the period 2ir/X) to reduce the varia¬ 
tional system to autonomous form. Note that the result is the 
system (53). This is referred to as the van der Pol method. 
The analysis of the variational system is referred to as the 
method of Andronow and Witt. 

2. Derive the variation of parameters equivalent of (46) for a 
solution of the form 

dx 

X = A cos (X( — $) — XA sin (Kl — 4>) 

where each of A and is a variable, and then use the method of 
averaging to reduce the variational S 3 'stem to an autonomous 
form. Discuss the relationship between this and the approach 
in Exercise 1. This is referred to as the method of the first approx- 
imaiion of Krylov and Bogoliubov. 

3. Discuss in detail the correspondence between (50) and (58). 
What modification in the variational equations (51) is required 
in order that the resonant and nonresonant cases merge? Show 
that any solution of the system 

^ 7^ TTT 

-H X. = ^ sin 3(( - e) 


satisfies Eq. (48) to first order in p for all values of X. Show that 
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for X nearly unity, this system leads to (58), while for X appreci¬ 
ably different from unity, it leads to (50). Use this system to 
discuss in detail the correspondence between the three forms 
(50), (58), and (GO). 

4. Discuss the asymptotic expansions, to first order in n, of 
the solution of (59) for X 1. In particular, verify (01). 


5 . The Forced Oscillations of the Duffnaj Equation 


For the Duffing equation 

^ + I = cos \t (02) 

ai‘ 


with (/3| small, we consider an asymptotic solution of the form 

X — A cos (/ — 0) + /3.ri -1- /SVo d'-' v (03) 

With X appreciably different from unity, we obtain, to first order 
in 0, the variational eciuations 


(it 

(it 



and the perturbational equation 

_(_ J., = A' (.os :i(; - 0) + Fo cos X( (64) 

The solution, to first order in 0, becomes 

X = A cos {t ~ 6) — -f}.- cos 3(/ — <?) + , \l (65) 

with A constant and 0 = do + ‘.i0A‘t. 8. Thus, in general, both 
the natural and impressed frequencies appear in the solution. 

The resonance case, X near 1, is of more interest. The resonant 
term in (04) is removed, expressed as the sum of tw'o nearly 
harmonic cos {t — 9) and sin {t — 0) terms, and then incorpo- 
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rated in the variational equations. The following system results 


dt 

dA 

dt 


I cos [(X - 1)« + 91 

^ sin 1(X - l)t + 9] 


These equations become 


dA 

dt 


^ sin $ 


- 1 + 


jSFo 

2A 


cos $ 



with $ = (X “ 1)< + 6. The singular solutions of (66) corre¬ 
spond to sin <l> = 0 and to the equation 



for the amplitude Ao. Corresponding to each real root Ao of 
(67), there is a periodic solution of (62) of frequency 


i.e., the impressed frequency, with a principal part of amplitude 
jAol, to first order in Equation (67) is merely a version of the 
equation for the bifurcation amplitudes of the Duffing equation 
introduced in Chap. 7 (see Eq. (18) and Fig. 2 of Chap. 7). 

In this case, we are able to obtain the nontrivial solutions of 
(66) in closed form.' From this closed form solution we can, of 
course, determine, among other things, the stability of each 
of the singular solutions. We then will have determined the 
stability of the corresponding periodic solutions of frequency X 
of (62). 

• The author is indebted to Mr. Steve M. Yionoulis for suggesting the 
Roncrnl integrability of the system (66). 
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Upon dividing the first equation in (66) by the second, there 
results the differential form 


FaA . , ^^31 

sm $ a4> — g /I’ + 




which is exact. The general integral 


FaA cos ^ + 


(^)- 




where c is a constant, is obtained immediately. The singular 
solutions appear for 


c = ± FoAo 4* 


A - l\ , , , 3 , , . Fo.-lo -3 , , 

+I6^“ = ± 


( 68 ) 


where Ao is a real root of (67), and the (±) sign is as in (07). 
It is convenient to map the solution curves into the van dcr Pol 
plane with a = i4 cos and b = A sin 4>. The system (DO) may 
be expressed in the form 


= _ /3 
0 (It \S 


1 ^ 
011 
1 ^ 
0dt 


A^ + 


X - 




^ / 


(69) 


with the singular solutions occurring for 6 = 0 and a = ±--lo, 
where /lo is a real root of (67). The solution curves in the a6 
plane become 

where, of course, ^4^ = 4- 6* is the square of the length of the 

radius vector. In particular, (70) is a quartic in a and 6. It is 
clear that all solutions are bounded, since the term {Hc)A* 
completely dominates all others for large A. 

For (X — l)/0 positive, (67) possesses exactly one real root, 
and the quartic curves (70) form a family of concentric closed 
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paths centered about the corresponding singular point a = ± Ao, 
6 = 0. These are best described by considering the locus 

which, according to the second equation in (69), is the isocline of 
horizontal tangents. The isocline (71) is illustrated in Fig. 8. 
Its intercept with the a axis is the singular point a = +i4o, 
6 = 0. In fact, the a axis is the isocline of vertical tangents. 
For c large in (70), the trajectory is very nearly the circle 


(^6)^^ = C 


As c decreases, the trajectory becomes distorted somewhat but 
remains a closed path. For c = 0, the solution passes through 
the origin and as c continues to decrease, the trajectory approxi¬ 
mates an ellipse with center at the singular point. The singular 
point is reached when c has decreased to the value in (68), which 
in this case will be negative. For c less than the value in (68), 
(70) will not yield a real trajectory. 

For (X — l)/jS negative, the picture may be considerably modi¬ 
fied. If Fo is sufficiently large, the locus (71) will be qualita¬ 
tively similar to that in Fig. 8, and there will be but one singular 
point as before. But if Fo is a small positive quantity, then the 
locus (71) will possess two branches. It is clear that exterior 
to the circle i-P = 8(1 — X)/3^, there is always a branch of the 
locus which is qualitatively similar to that in Fig. 8. However, 
for Fo small, inside this circle there will be a second branch which 
forms an oval and lies on the opposite side of the 6 axis. The 
limitation as to the size of Fo is clear, since the left-hand member 
of (71) vanishes everywhere on the circle A- = —8(X — l)/3/J, as 
well as along the 6 axis, and is thus bounded within. The com- 
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Eq. (71) 



Figure 8 
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plete locus (71) for a small positive Ft, is illustrated in Fig. 9. The 
circle A~ = 8(1 - X)/3)3 is a branch of the isocline of vertical 
tangents. The remaining branch is, of course, the a axis. In this 
case, (67) possesses three real roots which are represented by the 
intercepts of the locus (71) with the a axis. There are two centers 
and a saddle point arranged in an unusual pattern. The com- 



Figure 9 
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plete trajectory pattern is illustrated in Fig. 10. The saddle 
point and the right-hand center coalesce and then vanish along 
with the oval branch of (71), as Fo reaches and then exceeds the 
appropriate extremum in (71). The distant trajectories are very 



Figure 10 


nearly the circles = c, as before. With small Fo and 

as c decreases, a value is reached which corresponds to the right- 
hand center. This is the large.st of the three possible values in 
(68). For somewhat smaller values of c, there are two periodic 
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solutions, one large, one small. As c continues to decrease and 
becomes negative, a second of the values in (68) is reached. This 
corresponds to the saddle point and two looping separatrices. 
For still smaller c, a single (new and somewhat distorted) periodic 
solution exists, and as c decreases further, the final (minimum) 
value in (68) is reached. This corresponds to the left-hand 
center. Real solutions do not exist for smaller c. 

It is of some interest to consider the implications for (62) of 
these results. With an impressed frequency X nearly equal to 
the natural frequency, there exist periodic responses at the 
impressed frequency. The amplitude-frequency relationships 
for these are illustrated in Fig. 2 of Chap. 7 with a = 2(1 — X)/^ 
and |aol = lAol- Those points appearing along an upper branch 
of a constant Fo curve correspond to orbitally stable periodic 
solutions. Those points appearing along the lower-most portions 
of the parabola like branches also correspond to orbitally stable 
periodic solutions. Those points appearing along the upper 
portions of the parabola like branches correspond to unstable 
periodic solutions. Of the former two, each corresponds to a 
center of the variational system (69). The latter, of course, 
corresponds to the saddle point. In addition to the periodic 
responses, there may be a variety of almost periodic responses. 
These correspond to the nontrivial (periodic) solutions of the 
variational system (69). If a small amount of positive damping 
is introduced into (62), then the centers of (69) become asymp¬ 
totically stable foci (see Fig. 11). In such a case, the correspond¬ 
ing periodic responses of (62) at the frequency X become asymp¬ 
totically orbitally stable, and they each represent the dominant 
part of a steady-state response. 

Finally, let us illustrate briefly still another source of interest¬ 
ing nonlinear resonance phenomena. For the equation 


^ -h X = /Sx® -b Fi cos Xi( -h F 2 cos Xsi 


(72) 
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with two input frequencies Xi and Xj we assume an asymptotic 
solution of the form 

F F 

X = A cos (« - 0) + ^cos ^-V-o cos + /3 j, 

+ )3'X3 + • ■ • + (73) 

Here we assume that |Xi| and [Xjj arc each appreciably difTerent 
from 1 and introduce into the expansion terms which represent 
the linearized responses to the “hard” forcing function in (72). 



Figure 11 
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When (73) is substituted into (72), there appear a variety of 
possible resonant or near resonant terms. The frequencies 3Xi, 
3 X 2 , 2 X 1 ± X 2 , Xi ± 2 X 2 , 2 + Xi - 2 dQ/dt, 2 + X 2 - 2 dBldt, 
1 ± 2 X 1 — dB/dl, 1 ± 2 X 2 — dBldi are present in first-order terms 
(in &). Should one (or more) of these in absolute value be nearly 
unity, the corresponding term (or terms) would produce resonance 
or near resonance in the first-order perturbational equation for Xi. 
It (or they) should be shifted to the variational equations. For 
example, if 2Xi — X 2 is nearly unity in absolute value, and no 
others, then we are led to the first-order variational equations 


dt 


dA 

di 


3 3 3 

8 4 (1 - Xi*)* 4 (1 - 


2X1 — Xs 


3 

8 (1 - Xi)Hl - Xs*) 






SA{\ - Xi2)2(l - 


cos $ 


sin 4> 



where 4> = (2Xi — X 2 — l)i -|- 0. This system possesses the same 
structure as (66) and so it is unnecessary to discuss it further. 

In most cases, it is necessary to anticipate a variety of perturba¬ 
tional terms which have frequencies that are composed of linear 
combinations of the input frequencies Xi and X 2 with integral 
coefficients. Some of these combination frequencies may lead 
to resonance or near resonance in the higher-order approxima¬ 
tions. This is referred to as the problem of small divisors since 
if the resonant frequencies are not removed from the perturba¬ 
tional equation, they will lead to small divisors. In the present 
procedure, however, one merely shifts such potentially trouble¬ 
some terms to the variational equations, and the small divisors 
never materialize. 


EXERCISES 

1. In (65), let X< = 3(< — $) and express the solution in terms 
of the impressed frequency X. Note that the principal term of 
the response is a subharmonic of the input harmonic. Using (65), 
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obtain second-order resonant and nonresonant solutions of the 
Duffing equation (G2). Note that resonance occurs for X near 3. 
This is called subharmonic resonance. 

2. Discuss the limit as /3 —» 0 of the periodic solutions of (G2). 
Discuss the relationship between this and the bifurcation ampli¬ 
tudes for the Duffing equation introduced in Chap. 7. Xote 
the sharp distinction between the above limiting procedure and 
its counterpart in Chap. 7. 

3. Show how to use the integral (70) to express the solution of 
(GG) in closed form as an elliptic integral. 

4. Derive the system (74) and di.scuss its solutions. In par¬ 
ticular, show that a singular solution of (74) corresponds to a 
periodic leading term in (73) of frequency 2Xi — X;. This is called 
a combination frcqucncij (or tone) because it i.«, in general, neither 
a subharmonic nor a superharmonic of either of the input 
frequencies. 

5. Discu.ss the .several first-order resonance po.s.^ibilities in (72). 
Derive the variational eciuations, and discuss their solutions. 

G. Use the variation of parameters method in conjunction with 
the method of averaging to derive (GG). 

7. Consider the soft-forced equation 

d2r 

-I- j3Fo cos Xif -I- cos X:f 

where each of the input freciuencies Xi and X> is nearly unity. 
Introduce, into the second order, nonautonoinou.s variational 
system, two (suitable) auxiliary variables and express the varia¬ 
tional system as a Ihird-uriXor autonomous system. 

8 . Discuss the forced oscillations of the .sliglitly damped 
Duffing equation 

~ + X = Px' - + PFo cos \t 

In particular, verify the qualitative features of the solutions of 
the first-order variational system as illustrated in Fig. 11. 
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Periodic system, 106, 137,138, 

148 

Perturbation equation, 149, 150, 
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Perturbation matrix, 117 
Perturbation theory, 68, 194 
Perturbational equation, 228-260 


Phase plane, 1, 9, 12, 21, 25, 217 
Phase-plane concept, 25 
Phase-plane solution, 15, 16 
Phase-plane trajectory, 13-27, 
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Phase-space concept, 26 
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Poincar4-Bendixson theorem, 182, 
188, 247 
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Point trajectory, 25 
Polygonal approximation, 54 
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Product space, 49 
Projection, 49 

Quasi-harmonic equation, 203, 215 
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Rayleigh equation, 156 
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Relaxation oscillation, 192 
Resonance, 222, 231, 235, 249, 251, 
258, 260 

Rotary motion, 20 
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Satellite equation, 66, 68, 78 
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Secular part, 246 
Secular term, 69-71 
Separatrices, 18-24, 62, 184, 258 
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Singular solution, 2, 9, 16-33, 137, 
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Small divisors, 260 
Soft spring, 16 
Space curve, 33 
Spring characteristic, 19 
Squircle, 39, 40 

Stability, asymptotic, 130, 131, 
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218, 219, 248, 258 
Laplace, 129 
Liapunov, 129, 130, 244 
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Steady-state oscillation, 249 
Steady-state response, 150, 220, 
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Subharmonic, 260, 261 
Successive approximations, 41, 54, 
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Superharmonic, 261 
Superposition, 97 
Synchronization, 241 

Taxicab distance, 35 
Taxicab geometry, 35, 36 


Taxicab length, 35 
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Euclidean, 36 
uniform, 46, 49 
Trace, 88, 125, 153 
Trajectory, 1-13, 60-64. 130. 131, 
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Transversal, 181-186 
Triangular inequality. 37 
Triangular matrix. 101, 113 
Triangularization theorem. 104. 
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Uniform convergence 45-5S, 07. 
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Van der Pol equation, ISS, 190, 
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Van diT Pol method, 250 
A'an der Pol plane, 242, 246, 253 
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Variation of parameters. 00, 222. 

235, 236, 240, 250 
Variational equation, 223-260 
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Vector field, 184-187 
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